2024-06-13T11:26:24.127 INFO:root:teuthology version: 0.0.1.dev316+gc1b06c2 2024-06-13T11:26:24.127 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --verbose --owner scheduled_teuthology@teuthology --name teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752863 -- /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752863/orig.config.yaml 2024-06-13T11:26:24.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-13T11:26:24.261 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752863 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: ceph-qa@ceph.com first_in_suite: false job_id: '7752863' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 1373963c202323287783ccb099bbae1ec8f14a5d owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8815 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 250/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1373963c202323287783ccb099bbae1ec8f14a5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIBv6QXoldc8S+NFHr80poj50N4vsBjg1eoxnAKs5XI7m0MZlGL4t508pLuYB8W2qQITzwASIZ4QTftX0O8aGE= smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwI82qfIyyiEuTRkVUL5V4Q1/OJ/36BuDg5EeuvsJeHbi1WuD9vrVpUDkc8pXo8uVnJHYgssu4CSpjcBXpde9I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: c1b06c2b5d3a02a3583265a115f09e052855bcf2 timestamp: 2024-06-12_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-13T11:26:24.261 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa; will attempt to use it 2024-06-13T11:26:24.262 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks 2024-06-13T11:26:24.262 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-13T11:26:24.264 INFO:teuthology.task.internal:Checking packages... 2024-06-13T11:26:24.284 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-13T11:26:24.284 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-13T11:26:24.284 INFO:teuthology.packaging:ref: None 2024-06-13T11:26:24.284 INFO:teuthology.packaging:tag: None 2024-06-13T11:26:24.285 INFO:teuthology.packaging:branch: squid 2024-06-13T11:26:24.285 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:26:24.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-13T11:26:24.535 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2998.g1373963c 2024-06-13T11:26:24.537 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-13T11:26:24.736 INFO:teuthology.task.internal:no buildpackages task found 2024-06-13T11:26:24.737 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-13T11:26:24.772 INFO:teuthology.task.internal:Saving configuration 2024-06-13T11:26:24.789 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-13T11:26:24.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-13T11:26:24.818 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752863', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 11:21:48.963420', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIBv6QXoldc8S+NFHr80poj50N4vsBjg1eoxnAKs5XI7m0MZlGL4t508pLuYB8W2qQITzwASIZ4QTftX0O8aGE='} 2024-06-13T11:26:24.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752863', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 11:21:48.961444', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwI82qfIyyiEuTRkVUL5V4Q1/OJ/36BuDg5EeuvsJeHbi1WuD9vrVpUDkc8pXo8uVnJHYgssu4CSpjcBXpde9I='} 2024-06-13T11:26:24.840 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-13T11:26:24.849 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-06-13T11:26:24.849 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-06-13T11:26:24.849 INFO:teuthology.run_tasks:Running task console_log... 2024-06-13T11:26:24.905 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff6d9de3be0>, signals=[15]) 2024-06-13T11:26:24.905 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-13T11:26:24.914 INFO:teuthology.task.internal:Opening connections... 2024-06-13T11:26:24.914 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:26:24.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:26:24.990 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:26:24.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:26:25.069 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-13T11:26:25.079 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-06-13T11:26:25.097 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-06-13T11:26:25.098 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-06-13T11:26:25.157 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T11:26:25.158 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T11:26:25.159 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T11:26:25.159 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-06-13T11:26:25.185 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-06-13T11:26:25.204 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-06-13T11:26:25.204 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-06-13T11:26:25.262 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T11:26:25.263 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-06-13T11:26:25.263 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T11:26:25.263 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T11:26:25.263 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T11:26:25.263 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-06-13T11:26:25.285 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-13T11:26:25.298 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-13T11:26:25.310 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-13T11:26:25.310 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-06-13T11:26:25.312 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-06-13T11:26:25.328 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-13T11:26:25.340 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-13T11:26:25.340 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-06-13T11:26:25.369 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-06-13T11:26:25.400 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-13T11:26:25.454 INFO:teuthology.run_tasks:Running task kernel... 2024-06-13T11:26:25.473 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-13T11:26:25.473 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-06-13T11:26:25.473 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-06-13T11:26:25.474 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T11:26:25.474 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T11:26:25.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:26:25.491 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-06-13T11:26:25.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:26:25.492 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-06-13T11:26:25.548 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-437.el9.x86_64 2024-06-13T11:26:25.549 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-437.el9.x86_64 2024-06-13T11:26:25.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-06-13T11:26:25.550 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-437.el9.x86_64 2024-06-13T11:26:25.550 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-437.el9.x86_64 2024-06-13T11:26:25.550 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-06-13T11:26:27.639 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-06-13T11:26:27.831 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-06-13T11:26:29.483 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-06-13T11:26:29.565 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 37 MB/s | 20 MB 00:00 2024-06-13T11:26:34.857 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.3 MB 00:01 2024-06-13T11:26:36.083 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.3 MB 00:02 2024-06-13T11:26:36.433 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 17 kB 00:00 2024-06-13T11:26:37.567 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 17 kB 00:00 2024-06-13T11:26:37.595 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-06-13T11:26:38.530 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-06-13T11:26:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-06-13T11:26:44.044 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-13T11:26:45.240 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-13T11:26:45.241 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-13T11:26:45.324 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-06-13T11:26:45.330 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-06-13T11:26:45.330 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-06-13T11:26:45.330 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-06-13T11:26:45.330 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-457.el9 baseos 989 k 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 5.14.0-457.el9 baseos 16 M 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 5.14.0-457.el9 baseos 35 M 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core x86_64 5.14.0-457.el9 baseos 29 M 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout:Install 4 Packages 2024-06-13T11:26:45.331 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:26:45.332 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 81 M 2024-06-13T11:26:45.332 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 124 M 2024-06-13T11:26:45.332 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-06-13T11:26:45.577 INFO:teuthology.orchestra.run.smithi043.stdout:(1/4): kernel-5.14.0-457.el9.x86_64.rpm 5.0 MB/s | 989 kB 00:00 2024-06-13T11:26:45.978 INFO:teuthology.orchestra.run.smithi043.stdout:(2/4): kernel-core-5.14.0-457.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-06-13T11:26:46.191 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-13T11:26:46.191 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-13T11:26:46.284 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-06-13T11:26:46.296 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-06-13T11:26:46.296 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-06-13T11:26:46.296 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-06-13T11:26:46.296 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-06-13T11:26:46.296 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-457.el9 baseos 989 k 2024-06-13T11:26:46.296 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core x86_64 5.14.0-457.el9 baseos 16 M 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules x86_64 5.14.0-457.el9 baseos 35 M 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core x86_64 5.14.0-457.el9 baseos 29 M 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-06-13T11:26:46.297 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:26:46.298 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 81 M 2024-06-13T11:26:46.298 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 124 M 2024-06-13T11:26:46.298 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-06-13T11:26:46.594 INFO:teuthology.orchestra.run.smithi043.stdout:(3/4): kernel-modules-core-5.14.0-457.el9.x86_6 29 MB/s | 29 MB 00:01 2024-06-13T11:26:47.029 INFO:teuthology.orchestra.run.smithi043.stdout:(4/4): kernel-modules-5.14.0-457.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-06-13T11:26:47.029 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:26:47.029 INFO:teuthology.orchestra.run.smithi043.stdout:Total 48 MB/s | 81 MB 00:01 2024-06-13T11:26:47.395 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): kernel-5.14.0-457.el9.x86_64.rpm 1.2 MB/s | 989 kB 00:00 2024-06-13T11:26:47.760 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-06-13T11:26:47.970 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): kernel-core-5.14.0-457.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-06-13T11:26:48.201 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-06-13T11:26:48.201 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-06-13T11:26:48.704 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): kernel-modules-5.14.0-457.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-06-13T11:26:48.970 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): kernel-modules-core-5.14.0-457.el9.x86_6 18 MB/s | 29 MB 00:01 2024-06-13T11:26:48.974 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:26:48.974 INFO:teuthology.orchestra.run.smithi053.stdout:Total 30 MB/s | 81 MB 00:02 2024-06-13T11:26:49.171 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-06-13T11:26:49.171 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-06-13T11:26:49.715 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-06-13T11:26:50.144 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-06-13T11:26:50.144 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-06-13T11:26:51.137 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-06-13T11:26:51.137 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-06-13T11:26:51.733 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-06-13T11:26:52.380 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-core-5.14.0-457.el9.x86_64 1/4 2024-06-13T11:26:52.470 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-5.14.0-457.el9.x86_64 2/4 2024-06-13T11:26:53.696 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-06-13T11:26:54.356 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-core-5.14.0-457.el9.x86_64 1/4 2024-06-13T11:26:54.455 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-core-5.14.0-457.el9.x86_64 2/4 2024-06-13T11:26:55.257 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-457.el9.x86_64 2/4 2024-06-13T11:26:55.409 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-5.14.0-457.el9.x86_64 3/4 2024-06-13T11:26:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-457.el9.x86_64 2/4 2024-06-13T11:26:57.408 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-5.14.0-457.el9.x86_64 3/4 2024-06-13T11:27:00.511 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-457.el9.x86_64 3/4 2024-06-13T11:27:00.566 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:02.513 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-457.el9.x86_64 3/4 2024-06-13T11:27:02.572 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:05.686 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-core-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:07.689 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-core-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:36.726 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:36.770 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:37.084 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:37.084 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-457.el9.x86_64 1/4 2024-06-13T11:27:37.084 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-5.14.0-457.el9.x86_64 2/4 2024-06-13T11:27:37.084 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-5.14.0-457.el9.x86_64 3/4 2024-06-13T11:27:37.881 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-core-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:37.881 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:27:37.881 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-06-13T11:27:37.881 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-457.el9.x86_64 2024-06-13T11:27:37.881 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core-5.14.0-457.el9.x86_64 2024-06-13T11:27:37.882 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-5.14.0-457.el9.x86_64 2024-06-13T11:27:37.882 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core-5.14.0-457.el9.x86_64 2024-06-13T11:27:37.882 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:27:37.882 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-06-13T11:27:38.237 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-06-13T11:27:38.346 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-457.el9.x86_64 2024-06-13T11:27:38.346 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-457.el9.x86_64 2024-06-13T11:27:38.346 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-457.el9.x86_64 2024-06-13T11:27:38.347 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-13T11:27:38.347 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-13T11:27:38.347 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-06-13T11:27:38.347 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-06-13T11:27:38.347 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-06-13T11:27:38.402 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-457.el9.x86_64 2024-06-13T11:27:38.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-457.el9.x86_64 2024-06-13T11:27:38.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-06-13T11:27:38.434 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-06-13T11:27:38.434 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-06-13T11:27:38.434 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-06-13T11:27:38.434 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 68.el9 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8264254 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-06-13T11:27:38.435 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:27:38.436 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-06-13T11:27:38.437 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-13T11:27:38.437 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 5.14.0-457.el9.x86_64 2024-06-13T11:27:38.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-13T11:27:38.602 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:38.644 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:38.943 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:38.943 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-457.el9.x86_64 1/4 2024-06-13T11:27:38.943 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-core-5.14.0-457.el9.x86_64 2/4 2024-06-13T11:27:38.944 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-5.14.0-457.el9.x86_64 3/4 2024-06-13T11:27:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-06-13T11:27:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-core-5.14.0-457.el9.x86_64 4/4 2024-06-13T11:27:39.764 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-457.el9.x86_64 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core-5.14.0-457.el9.x86_64 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-5.14.0-457.el9.x86_64 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core-5.14.0-457.el9.x86_64 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:27:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-06-13T11:27:40.134 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-06-13T11:27:40.218 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-457.el9.x86_64 2024-06-13T11:27:40.219 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-457.el9.x86_64 2024-06-13T11:27:40.219 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-457.el9.x86_64 2024-06-13T11:27:40.219 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-13T11:27:40.219 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-13T11:27:40.219 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-06-13T11:27:40.219 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-06-13T11:27:40.219 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-06-13T11:27:40.274 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-457.el9.x86_64 2024-06-13T11:27:40.274 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-457.el9.x86_64 2024-06-13T11:27:40.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-06-13T11:27:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-06-13T11:27:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-06-13T11:27:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-06-13T11:27:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 68.el9 2024-06-13T11:27:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-06-13T11:27:40.305 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8264254 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-06-13T11:27:40.306 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:27:40.307 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-06-13T11:27:40.308 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-13T11:27:40.308 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 5.14.0-457.el9.x86_64 2024-06-13T11:27:40.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-13T11:27:40.592 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-13T11:27:40.615 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-06-13T11:27:40.618 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-06-13T11:27:40.685 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.RfUNLVn9yX 2024-06-13T11:27:40.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RfUNLVn9yX 2024-06-13T11:27:40.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.RfUNLVn9yX 2024-06-13T11:27:40.894 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.RfUNLVn9yX is 6KB 2024-06-13T11:27:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-06-13T11:27:40.944 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.RfUNLVn9yX 2024-06-13T11:27:40.958 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-06-13T11:27:41.020 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-13T11:27:41.020 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-13T11:27:41.020 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-13T11:27:41.020 INFO:teuthology.orchestra.run.smithi043.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-457.el9.x86_64.conf 2024-06-13T11:27:41.022 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-457.el9.x86_64 2024-06-13T11:27:41.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-06-13T11:27:42.315 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-13T11:27:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-06-13T11:27:42.353 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-06-13T11:27:42.368 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.f0LVZAFCU0 2024-06-13T11:27:42.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f0LVZAFCU0 2024-06-13T11:27:42.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.f0LVZAFCU0 2024-06-13T11:27:42.569 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.f0LVZAFCU0 is 6KB 2024-06-13T11:27:42.617 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.f0LVZAFCU0 2024-06-13T11:27:42.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-06-13T11:27:42.695 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-13T11:27:42.695 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-13T11:27:42.695 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-13T11:27:42.695 INFO:teuthology.orchestra.run.smithi053.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-457.el9.x86_64.conf 2024-06-13T11:27:42.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-457.el9.x86_64 2024-06-13T11:27:42.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-06-13T11:28:11.204 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-13T11:28:11.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-06-13T11:28:11.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:28:12.862 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-06-13T11:28:12.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-06-13T11:28:12.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:28:29.727 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-06-13T11:28:31.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-06-13T11:28:38.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-06-13T11:28:38.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:28:40.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-06-13T11:28:40.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:28:58.655 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-06-13T11:29:10.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-06-13T11:29:10.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:29:11.019 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-06-13T11:29:11.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-06-13T11:29:11.442 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-457.el9.x86_64"... 2024-06-13T11:29:11.442 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-06-13T11:29:11.457 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-457.el9.x86_64 2024-06-13T11:29:11.458 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-457.el9.x86_64 vs 5.14.0-457.el9.x86_64 2024-06-13T11:29:11.458 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-13T11:29:11.458 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-13T11:29:12.459 DEBUG:teuthology.parallel:result is None 2024-06-13T11:29:38.739 DEBUG:teuthology.orchestra.remote:timed out 2024-06-13T11:29:50.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-06-13T11:29:50.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:29:51.059 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-06-13T11:29:51.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-06-13T11:29:51.443 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-457.el9.x86_64"... 2024-06-13T11:29:51.444 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-06-13T11:29:51.461 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-457.el9.x86_64 2024-06-13T11:29:51.461 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-457.el9.x86_64 vs 5.14.0-457.el9.x86_64 2024-06-13T11:29:51.461 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-13T11:29:51.461 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-13T11:29:52.462 DEBUG:teuthology.parallel:result is None 2024-06-13T11:29:52.462 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-13T11:29:52.472 INFO:teuthology.task.internal:Creating test directory... 2024-06-13T11:29:52.472 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T11:29:52.474 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T11:29:52.496 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-13T11:29:52.502 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-13T11:29:52.509 INFO:teuthology.task.internal:Creating archive directory... 2024-06-13T11:29:52.510 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T11:29:52.534 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T11:29:52.564 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-13T11:29:52.570 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-13T11:29:52.570 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T11:29:52.597 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T11:29:52.660 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T11:29:52.687 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T11:29:52.695 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T11:29:52.741 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T11:29:52.743 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-13T11:29:52.750 INFO:teuthology.task.internal:Configuring sudo... 2024-06-13T11:29:52.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T11:29:52.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T11:29:52.782 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-13T11:29:52.791 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-13T11:29:52.791 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T11:29:52.824 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T11:29:52.842 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T11:29:52.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T11:29:52.980 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T11:29:53.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T11:29:53.111 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:29:53.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T11:29:53.180 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T11:29:53.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T11:29:53.283 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T11:29:53.370 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T11:29:53.414 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:29:53.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T11:29:53.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-06-13T11:29:53.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-06-13T11:29:53.530 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T11:29:53.575 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T11:29:54.010 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-13T11:29:54.018 INFO:teuthology.task.internal:Starting timer... 2024-06-13T11:29:54.018 INFO:teuthology.run_tasks:Running task pcp... 2024-06-13T11:29:54.028 INFO:teuthology.run_tasks:Running task selinux... 2024-06-13T11:29:54.035 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-06-13T11:29:54.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-06-13T11:29:54.097 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-06-13T11:29:54.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-06-13T11:29:54.171 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-06-13T11:29:54.173 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-13T11:29:54.174 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-06-13T11:29:54.198 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-06-13T11:29:54.198 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-06-13T11:29:54.225 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-06-13T11:29:54.226 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi053.front.sepia.ceph.com': 'permissive'} 2024-06-13T11:29:54.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T11:29:54.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:29:54.268 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T11:29:54.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:29:54.297 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-13T11:29:54.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-06-13T11:29:54.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-06-13T11:29:54.371 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-13T11:29:54.380 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-13T11:29:54.383 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-13T11:29:54.493 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-13T11:29:54.505 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-13T11:29:54.506 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi053.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-13T11:34:21.520 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi053.front.sepia.ceph.com')] 2024-06-13T11:34:21.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-06-13T11:34:21.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:34:21.601 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-06-13T11:34:21.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-06-13T11:34:21.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-06-13T11:34:21.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:34:21.753 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-06-13T11:34:21.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-06-13T11:34:21.837 INFO:teuthology.run_tasks:Running task clock... 2024-06-13T11:34:21.849 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-13T11:34:21.849 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T11:34:21.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:34:21.852 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T11:34:21.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:34:21.881 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T11:34:21.896 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T11:34:21.908 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T11:34:21.921 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-06-13T11:34:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T11:34:21.933 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-06-13T11:34:21.948 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T11:34:21.950 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-06-13T11:34:21.962 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-06-13T11:34:21.963 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T11:34:21.977 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T11:34:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T11:34:22.022 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:34:22.025 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:34:22.026 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-06-13T11:34:22.026 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.026 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.026 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.026 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.049 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:34:22.053 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:34:22.053 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-06-13T11:34:22.054 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.054 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.054 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.054 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:34:22.054 INFO:teuthology.run_tasks:Running task install... 2024-06-13T11:34:22.063 DEBUG:teuthology.task.install:project ceph 2024-06-13T11:34:22.063 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-13T11:34:22.063 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-13T11:34:22.063 INFO:teuthology.task.install:Using flavor: default 2024-06-13T11:34:22.068 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-13T11:34:22.068 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-13T11:34:22.069 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T11:34:22.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:34:22.071 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T11:34:22.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:34:22.299 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T11:34:22.299 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T11:34:22.302 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T11:34:22.303 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T11:34:22.412 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T11:34:22.412 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:34:22.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T11:34:22.417 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T11:34:22.417 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:34:22.417 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T11:34:22.441 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T11:34:22.441 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T11:34:22.445 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T11:34:22.445 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T11:34:22.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T11:34:22.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T11:34:22.587 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T11:34:22.591 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T11:34:22.654 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-06-13T11:34:22.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-06-13T11:34:22.657 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-06-13T11:34:22.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-06-13T11:34:22.893 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-06-13T11:34:22.900 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-06-13T11:34:22.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T11:34:22.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T11:34:23.529 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 264 kB/s | 83 kB 00:00 2024-06-13T11:34:23.681 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 179 kB/s | 83 kB 00:00 2024-06-13T11:34:23.963 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-06-13T11:34:24.074 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-06-13T11:34:24.389 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-06-13T11:34:24.466 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-06-13T11:34:24.847 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.1 MB 00:00 2024-06-13T11:34:25.507 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.1 MB 00:00 2024-06-13T11:34:27.834 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-06-13T11:34:28.851 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-06-13T11:34:32.407 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.3 MB 00:00 2024-06-13T11:34:33.060 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.3 MB 00:00 2024-06-13T11:34:33.800 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 120 kB/s | 17 kB 00:00 2024-06-13T11:34:34.804 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-06-13T11:34:35.502 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 17 kB 00:01 2024-06-13T11:34:36.465 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-06-13T11:34:40.335 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-06-13T11:34:41.937 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi043.stdout:Install 148 Packages 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 12 Packages 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 226 M 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi043.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-06-13T11:34:44.411 INFO:teuthology.orchestra.run.smithi043.stdout:(2/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 890 kB 00:00 2024-06-13T11:34:44.440 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:34:44.441 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:34:44.453 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T11:34:44.454 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T11:34:44.455 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T11:34:44.455 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:34:44.457 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T11:34:44.460 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T11:34:44.460 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T11:34:44.520 INFO:teuthology.orchestra.run.smithi043.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 1.3 MB/s | 145 kB 00:00 2024-06-13T11:34:44.530 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-06-13T11:34:44.545 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-06-13T11:34:44.545 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T11:34:44.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T11:34:44.547 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T11:34:44.548 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T11:34:44.549 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T11:34:44.550 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T11:34:44.551 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T11:34:44.552 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T11:34:44.553 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T11:34:44.554 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T11:34:44.555 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T11:34:44.556 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-06-13T11:34:44.557 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout:Install 148 Packages 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 12 Packages 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 226 M 2024-06-13T11:34:44.558 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-06-13T11:34:44.745 INFO:teuthology.orchestra.run.smithi043.stdout:(4/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-06-13T11:34:44.862 INFO:teuthology.orchestra.run.smithi043.stdout:(5/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 2.4 MB 00:00 2024-06-13T11:34:44.954 INFO:teuthology.orchestra.run.smithi043.stdout:(6/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-06-13T11:34:45.205 INFO:teuthology.orchestra.run.smithi053.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-06-13T11:34:45.321 INFO:teuthology.orchestra.run.smithi043.stdout:(7/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 10 MB/s | 4.7 MB 00:00 2024-06-13T11:34:45.889 INFO:teuthology.orchestra.run.smithi053.stdout:(2/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.3 MB/s | 890 kB 00:00 2024-06-13T11:34:46.081 INFO:teuthology.orchestra.run.smithi053.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 756 kB/s | 145 kB 00:00 2024-06-13T11:34:46.413 INFO:teuthology.orchestra.run.smithi043.stdout:(8/160): ceph-radosgw-19.0.0-2946.g3d89accf.el9 9.4 MB/s | 10 MB 00:01 2024-06-13T11:34:46.513 INFO:teuthology.orchestra.run.smithi043.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 252 kB/s | 25 kB 00:00 2024-06-13T11:34:46.905 INFO:teuthology.orchestra.run.smithi043.stdout:(10/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 8.6 MB/s | 17 MB 00:01 2024-06-13T11:34:47.022 INFO:teuthology.orchestra.run.smithi043.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.9 MB/s | 221 kB 00:00 2024-06-13T11:34:47.122 INFO:teuthology.orchestra.run.smithi043.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 270 kB/s | 27 kB 00:00 2024-06-13T11:34:47.222 INFO:teuthology.orchestra.run.smithi043.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 317 kB/s | 32 kB 00:00 2024-06-13T11:34:47.381 INFO:teuthology.orchestra.run.smithi053.stdout:(4/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 1.8 MB/s | 2.4 MB 00:01 2024-06-13T11:34:47.431 INFO:teuthology.orchestra.run.smithi043.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.5 MB/s | 747 kB 00:00 2024-06-13T11:34:47.540 INFO:teuthology.orchestra.run.smithi043.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 1.5 MB/s | 163 kB 00:00 2024-06-13T11:34:47.657 INFO:teuthology.orchestra.run.smithi043.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 1.1 MB/s | 127 kB 00:00 2024-06-13T11:34:47.782 INFO:teuthology.orchestra.run.smithi043.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 3.9 MB/s | 501 kB 00:00 2024-06-13T11:34:48.198 INFO:teuthology.orchestra.run.smithi053.stdout:(5/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 1.8 MB/s | 1.5 MB 00:00 2024-06-13T11:34:48.273 INFO:teuthology.orchestra.run.smithi053.stdout:(6/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-06-13T11:34:48.724 INFO:teuthology.orchestra.run.smithi043.stdout:(18/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 5.7 MB/s | 5.3 MB 00:00 2024-06-13T11:34:48.841 INFO:teuthology.orchestra.run.smithi043.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 387 kB/s | 45 kB 00:00 2024-06-13T11:34:48.949 INFO:teuthology.orchestra.run.smithi043.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 1.2 MB/s | 135 kB 00:00 2024-06-13T11:34:49.067 INFO:teuthology.orchestra.run.smithi043.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 1.4 MB/s | 162 kB 00:00 2024-06-13T11:34:49.217 INFO:teuthology.orchestra.run.smithi043.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 2.1 MB/s | 321 kB 00:00 2024-06-13T11:34:49.334 INFO:teuthology.orchestra.run.smithi043.stdout:(23/160): python3-rbd-19.0.0-2946.g3d89accf.el9 2.5 MB/s | 300 kB 00:00 2024-06-13T11:34:49.409 INFO:teuthology.orchestra.run.smithi043.stdout:(24/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-13T11:34:49.493 INFO:teuthology.orchestra.run.smithi043.stdout:(25/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.0 MB/s | 85 kB 00:00 2024-06-13T11:34:49.515 INFO:teuthology.orchestra.run.smithi053.stdout:(7/160): ceph-common-19.0.0-2946.g3d89accf.el9. 4.5 MB/s | 21 MB 00:04 2024-06-13T11:34:50.126 INFO:teuthology.orchestra.run.smithi043.stdout:(26/160): ceph-common-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 21 MB 00:06 2024-06-13T11:34:50.177 INFO:teuthology.orchestra.run.smithi043.stdout:(27/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 4.5 MB/s | 3.1 MB 00:00 2024-06-13T11:34:50.207 INFO:teuthology.orchestra.run.smithi053.stdout:(8/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 2.3 MB/s | 4.7 MB 00:02 2024-06-13T11:34:50.227 INFO:teuthology.orchestra.run.smithi043.stdout:(28/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.7 MB/s | 171 kB 00:00 2024-06-13T11:34:50.265 INFO:teuthology.orchestra.run.smithi053.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 433 kB/s | 25 kB 00:00 2024-06-13T11:34:50.285 INFO:teuthology.orchestra.run.smithi043.stdout:(29/160): ceph-grafana-dashboards-19.0.0-2946.g 293 kB/s | 32 kB 00:00 2024-06-13T11:34:50.319 INFO:teuthology.orchestra.run.smithi043.stdout:(30/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.5 MB/s | 142 kB 00:00 2024-06-13T11:34:50.895 INFO:teuthology.orchestra.run.smithi043.stdout:(31/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 5.8 MB/s | 3.5 MB 00:00 2024-06-13T11:34:50.966 INFO:teuthology.orchestra.run.smithi053.stdout:(10/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 7.1 MB/s | 10 MB 00:01 2024-06-13T11:34:50.978 INFO:teuthology.orchestra.run.smithi043.stdout:(32/160): ceph-mgr-modules-core-19.0.0-2946.g3d 2.9 MB/s | 249 kB 00:00 2024-06-13T11:34:51.049 INFO:teuthology.orchestra.run.smithi053.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.6 MB/s | 221 kB 00:00 2024-06-13T11:34:51.062 INFO:teuthology.orchestra.run.smithi043.stdout:(33/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 593 kB/s | 49 kB 00:00 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi053.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 325 kB/s | 27 kB 00:00 2024-06-13T11:34:51.137 INFO:teuthology.orchestra.run.smithi043.stdout:(34/160): ceph-prometheus-alerts-19.0.0-2946.g3 219 kB/s | 16 kB 00:00 2024-06-13T11:34:51.208 INFO:teuthology.orchestra.run.smithi053.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 424 kB/s | 32 kB 00:00 2024-06-13T11:34:51.229 INFO:teuthology.orchestra.run.smithi043.stdout:(35/160): ceph-volume-19.0.0-2946.g3d89accf.el9 2.8 MB/s | 264 kB 00:00 2024-06-13T11:34:51.400 INFO:teuthology.orchestra.run.smithi053.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.8 MB/s | 747 kB 00:00 2024-06-13T11:34:51.429 INFO:teuthology.orchestra.run.smithi043.stdout:(36/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 3.7 MB/s | 763 kB 00:00 2024-06-13T11:34:51.492 INFO:teuthology.orchestra.run.smithi053.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 1.7 MB/s | 163 kB 00:00 2024-06-13T11:34:51.521 INFO:teuthology.orchestra.run.smithi043.stdout:(37/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 199 kB/s | 18 kB 00:00 2024-06-13T11:34:51.584 INFO:teuthology.orchestra.run.smithi053.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 1.4 MB/s | 127 kB 00:00 2024-06-13T11:34:51.684 INFO:teuthology.orchestra.run.smithi053.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 4.9 MB/s | 501 kB 00:00 2024-06-13T11:34:52.038 INFO:teuthology.orchestra.run.smithi043.stdout:(38/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 8.7 MB/s | 48 MB 00:05 2024-06-13T11:34:52.181 INFO:teuthology.orchestra.run.smithi043.stdout:(39/160): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-06-13T11:34:52.185 INFO:teuthology.orchestra.run.smithi053.stdout:(18/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 11 MB/s | 5.3 MB 00:00 2024-06-13T11:34:52.252 INFO:teuthology.orchestra.run.smithi053.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 680 kB/s | 45 kB 00:00 2024-06-13T11:34:52.327 INFO:teuthology.orchestra.run.smithi053.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 1.8 MB/s | 135 kB 00:00 2024-06-13T11:34:52.411 INFO:teuthology.orchestra.run.smithi053.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 1.9 MB/s | 162 kB 00:00 2024-06-13T11:34:52.494 INFO:teuthology.orchestra.run.smithi053.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 3.8 MB/s | 321 kB 00:00 2024-06-13T11:34:52.505 INFO:teuthology.orchestra.run.smithi043.stdout:(40/160): fuse-2.9.9-15.el9.x86_64.rpm 82 kB/s | 80 kB 00:00 2024-06-13T11:34:52.578 INFO:teuthology.orchestra.run.smithi053.stdout:(23/160): python3-rbd-19.0.0-2946.g3d89accf.el9 3.5 MB/s | 300 kB 00:00 2024-06-13T11:34:52.648 INFO:teuthology.orchestra.run.smithi043.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 447 kB/s | 195 kB 00:00 2024-06-13T11:34:52.653 INFO:teuthology.orchestra.run.smithi053.stdout:(24/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-13T11:34:52.720 INFO:teuthology.orchestra.run.smithi053.stdout:(25/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.2 MB/s | 85 kB 00:00 2024-06-13T11:34:52.723 INFO:teuthology.orchestra.run.smithi043.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-06-13T11:34:52.906 INFO:teuthology.orchestra.run.smithi043.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-06-13T11:34:52.940 INFO:teuthology.orchestra.run.smithi043.stdout:(44/160): libgfortran-11.4.1-3.el9.x86_64.rpm 921 kB/s | 803 kB 00:00 2024-06-13T11:34:52.965 INFO:teuthology.orchestra.run.smithi043.stdout:(45/160): python3-ply-3.11-14.el9.noarch.rpm 440 kB/s | 106 kB 00:00 2024-06-13T11:34:53.007 INFO:teuthology.orchestra.run.smithi043.stdout:(46/160): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-06-13T11:34:53.065 INFO:teuthology.orchestra.run.smithi043.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-06-13T11:34:53.070 INFO:teuthology.orchestra.run.smithi053.stdout:(26/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 3.5 MB/s | 17 MB 00:04 2024-06-13T11:34:53.099 INFO:teuthology.orchestra.run.smithi043.stdout:(48/160): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-06-13T11:34:53.129 INFO:teuthology.orchestra.run.smithi053.stdout:(27/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 7.6 MB/s | 3.1 MB 00:00 2024-06-13T11:34:53.154 INFO:teuthology.orchestra.run.smithi053.stdout:(28/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.0 MB/s | 171 kB 00:00 2024-06-13T11:34:53.166 INFO:teuthology.orchestra.run.smithi043.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-06-13T11:34:53.179 INFO:teuthology.orchestra.run.smithi053.stdout:(29/160): ceph-grafana-dashboards-19.0.0-2946.g 635 kB/s | 32 kB 00:00 2024-06-13T11:34:53.192 INFO:teuthology.orchestra.run.smithi043.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-06-13T11:34:53.205 INFO:teuthology.orchestra.run.smithi053.stdout:(30/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.8 MB/s | 142 kB 00:00 2024-06-13T11:34:53.208 INFO:teuthology.orchestra.run.smithi043.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-06-13T11:34:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 981 kB/s | 33 kB 00:00 2024-06-13T11:34:53.267 INFO:teuthology.orchestra.run.smithi043.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-06-13T11:34:53.301 INFO:teuthology.orchestra.run.smithi043.stdout:(54/160): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-06-13T11:34:53.327 INFO:teuthology.orchestra.run.smithi043.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 309 kB/s | 18 kB 00:00 2024-06-13T11:34:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 203 kB/s | 11 kB 00:00 2024-06-13T11:34:53.386 INFO:teuthology.orchestra.run.smithi043.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-06-13T11:34:53.411 INFO:teuthology.orchestra.run.smithi043.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 834 kB/s | 45 kB 00:00 2024-06-13T11:34:53.445 INFO:teuthology.orchestra.run.smithi043.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-13T11:34:53.478 INFO:teuthology.orchestra.run.smithi043.stdout:(60/160): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-06-13T11:34:53.481 INFO:teuthology.orchestra.run.smithi053.stdout:(31/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 12 MB/s | 3.5 MB 00:00 2024-06-13T11:34:53.504 INFO:teuthology.orchestra.run.smithi043.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-06-13T11:34:53.529 INFO:teuthology.orchestra.run.smithi043.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-06-13T11:34:53.554 INFO:teuthology.orchestra.run.smithi043.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-13T11:34:53.573 INFO:teuthology.orchestra.run.smithi053.stdout:(32/160): ceph-mgr-modules-core-19.0.0-2946.g3d 2.7 MB/s | 249 kB 00:00 2024-06-13T11:34:53.579 INFO:teuthology.orchestra.run.smithi043.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-13T11:34:53.596 INFO:teuthology.orchestra.run.smithi043.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 839 kB/s | 35 kB 00:00 2024-06-13T11:34:53.631 INFO:teuthology.orchestra.run.smithi053.stdout:(33/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 846 kB/s | 49 kB 00:00 2024-06-13T11:34:53.655 INFO:teuthology.orchestra.run.smithi043.stdout:(66/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.2 MB/s | 3.0 MB 00:00 2024-06-13T11:34:53.698 INFO:teuthology.orchestra.run.smithi053.stdout:(34/160): ceph-prometheus-alerts-19.0.0-2946.g3 248 kB/s | 16 kB 00:00 2024-06-13T11:34:53.722 INFO:teuthology.orchestra.run.smithi043.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-06-13T11:34:53.782 INFO:teuthology.orchestra.run.smithi053.stdout:(35/160): ceph-volume-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 264 kB 00:00 2024-06-13T11:34:53.789 INFO:teuthology.orchestra.run.smithi043.stdout:(68/160): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-06-13T11:34:53.858 INFO:teuthology.orchestra.run.smithi043.stdout:(69/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-06-13T11:34:53.881 INFO:teuthology.orchestra.run.smithi043.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-06-13T11:34:53.899 INFO:teuthology.orchestra.run.smithi053.stdout:(36/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-13T11:34:53.915 INFO:teuthology.orchestra.run.smithi043.stdout:(71/160): postgresql-contrib-13.14-1.el9.x86_64 4.6 MB/s | 911 kB 00:00 2024-06-13T11:34:53.949 INFO:teuthology.orchestra.run.smithi043.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-06-13T11:34:53.966 INFO:teuthology.orchestra.run.smithi053.stdout:(37/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 274 kB/s | 18 kB 00:00 2024-06-13T11:34:53.974 INFO:teuthology.orchestra.run.smithi043.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-06-13T11:34:54.007 INFO:teuthology.orchestra.run.smithi043.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-06-13T11:34:54.091 INFO:teuthology.orchestra.run.smithi043.stdout:(75/160): postgresql-server-13.14-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-06-13T11:34:54.108 INFO:teuthology.orchestra.run.smithi053.stdout:(38/160): fuse-2.9.9-15.el9.x86_64.rpm 567 kB/s | 80 kB 00:00 2024-06-13T11:34:54.116 INFO:teuthology.orchestra.run.smithi043.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-06-13T11:34:54.142 INFO:teuthology.orchestra.run.smithi043.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-06-13T11:34:54.158 INFO:teuthology.orchestra.run.smithi043.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-06-13T11:34:54.176 INFO:teuthology.orchestra.run.smithi043.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 571 kB/s | 19 kB 00:00 2024-06-13T11:34:54.201 INFO:teuthology.orchestra.run.smithi043.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-06-13T11:34:54.218 INFO:teuthology.orchestra.run.smithi043.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-06-13T11:34:54.250 INFO:teuthology.orchestra.run.smithi053.stdout:(39/160): libgfortran-11.4.1-3.el9.x86_64.rpm 5.5 MB/s | 803 kB 00:00 2024-06-13T11:34:54.302 INFO:teuthology.orchestra.run.smithi043.stdout:(82/160): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-06-13T11:34:54.308 INFO:teuthology.orchestra.run.smithi053.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-06-13T11:34:54.327 INFO:teuthology.orchestra.run.smithi043.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-06-13T11:34:54.352 INFO:teuthology.orchestra.run.smithi043.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-06-13T11:34:54.389 INFO:teuthology.orchestra.run.smithi043.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 77 kB 00:00 2024-06-13T11:34:54.409 INFO:teuthology.orchestra.run.smithi053.stdout:(41/160): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-06-13T11:34:54.411 INFO:teuthology.orchestra.run.smithi043.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 718 kB/s | 42 kB 00:00 2024-06-13T11:34:54.437 INFO:teuthology.orchestra.run.smithi043.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 5.5 MB/s | 269 kB 00:00 2024-06-13T11:34:54.442 INFO:teuthology.orchestra.run.smithi053.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-06-13T11:34:54.462 INFO:teuthology.orchestra.run.smithi043.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-13T11:34:54.487 INFO:teuthology.orchestra.run.smithi043.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-13T11:34:54.492 INFO:teuthology.orchestra.run.smithi053.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-06-13T11:34:54.513 INFO:teuthology.orchestra.run.smithi043.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-13T11:34:54.538 INFO:teuthology.orchestra.run.smithi043.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-13T11:34:54.543 INFO:teuthology.orchestra.run.smithi053.stdout:(44/160): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-06-13T11:34:54.580 INFO:teuthology.orchestra.run.smithi043.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-06-13T11:34:54.593 INFO:teuthology.orchestra.run.smithi053.stdout:(45/160): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-06-13T11:34:54.660 INFO:teuthology.orchestra.run.smithi053.stdout:(46/160): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-06-13T11:34:54.663 INFO:teuthology.orchestra.run.smithi043.stdout:(93/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-06-13T11:34:54.686 INFO:teuthology.orchestra.run.smithi053.stdout:(47/160): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-06-13T11:34:54.689 INFO:teuthology.orchestra.run.smithi043.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-06-13T11:34:54.706 INFO:teuthology.orchestra.run.smithi043.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-06-13T11:34:54.731 INFO:teuthology.orchestra.run.smithi043.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-06-13T11:34:54.756 INFO:teuthology.orchestra.run.smithi043.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-06-13T11:34:54.790 INFO:teuthology.orchestra.run.smithi043.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-06-13T11:34:54.815 INFO:teuthology.orchestra.run.smithi043.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-06-13T11:34:54.840 INFO:teuthology.orchestra.run.smithi043.stdout:(100/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rp 1.8 MB/s | 95 kB 00:00 2024-06-13T11:34:54.866 INFO:teuthology.orchestra.run.smithi043.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-13T11:34:54.891 INFO:teuthology.orchestra.run.smithi043.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi053.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-06-13T11:34:55.028 INFO:teuthology.orchestra.run.smithi053.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-06-13T11:34:55.053 INFO:teuthology.orchestra.run.smithi053.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-06-13T11:34:55.087 INFO:teuthology.orchestra.run.smithi053.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-06-13T11:34:55.112 INFO:teuthology.orchestra.run.smithi053.stdout:(52/160): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-06-13T11:34:55.133 INFO:teuthology.orchestra.run.smithi043.stdout:(103/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-06-13T11:34:55.147 INFO:teuthology.orchestra.run.smithi053.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-06-13T11:34:55.150 INFO:teuthology.orchestra.run.smithi043.stdout:(104/160): lua-devel-5.4.4-4.el9.x86_64.rpm 78 kB/s | 22 kB 00:00 2024-06-13T11:34:55.197 INFO:teuthology.orchestra.run.smithi053.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-06-13T11:34:55.250 INFO:teuthology.orchestra.run.smithi043.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-06-13T11:34:55.255 INFO:teuthology.orchestra.run.smithi053.stdout:(55/160): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-06-13T11:34:55.267 INFO:teuthology.orchestra.run.smithi043.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-06-13T11:34:55.293 INFO:teuthology.orchestra.run.smithi043.stdout:(107/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.1 MB/s | 309 kB 00:00 2024-06-13T11:34:55.309 INFO:teuthology.orchestra.run.smithi043.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-06-13T11:34:55.314 INFO:teuthology.orchestra.run.smithi053.stdout:(56/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-06-13T11:34:55.335 INFO:teuthology.orchestra.run.smithi043.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-13T11:34:55.360 INFO:teuthology.orchestra.run.smithi043.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-06-13T11:34:55.364 INFO:teuthology.orchestra.run.smithi053.stdout:(57/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-06-13T11:34:55.385 INFO:teuthology.orchestra.run.smithi043.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-06-13T11:34:55.427 INFO:teuthology.orchestra.run.smithi043.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-06-13T11:34:55.439 INFO:teuthology.orchestra.run.smithi053.stdout:(58/160): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-06-13T11:34:55.453 INFO:teuthology.orchestra.run.smithi043.stdout:(113/160): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-06-13T11:34:55.520 INFO:teuthology.orchestra.run.smithi043.stdout:(114/160): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-06-13T11:34:55.537 INFO:teuthology.orchestra.run.smithi043.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 2.3 MB/s | 32 kB 00:00 2024-06-13T11:34:55.554 INFO:teuthology.orchestra.run.smithi043.stdout:(116/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-06-13T11:34:55.571 INFO:teuthology.orchestra.run.smithi043.stdout:(117/160): python3-certifi-2021.10.8-2.el9.noar 447 kB/s | 15 kB 00:00 2024-06-13T11:34:55.604 INFO:teuthology.orchestra.run.smithi043.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-13T11:34:55.630 INFO:teuthology.orchestra.run.smithi043.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-06-13T11:34:55.655 INFO:teuthology.orchestra.run.smithi043.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-06-13T11:34:55.680 INFO:teuthology.orchestra.run.smithi043.stdout:(121/160): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-13T11:34:55.681 INFO:teuthology.orchestra.run.smithi053.stdout:(59/160): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-06-13T11:34:55.706 INFO:teuthology.orchestra.run.smithi043.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-06-13T11:34:55.731 INFO:teuthology.orchestra.run.smithi043.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-06-13T11:34:55.758 INFO:teuthology.orchestra.run.smithi043.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-06-13T11:34:55.765 INFO:teuthology.orchestra.run.smithi053.stdout:(60/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 306 kB/s | 25 kB 00:00 2024-06-13T11:34:55.781 INFO:teuthology.orchestra.run.smithi043.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-06-13T11:34:55.807 INFO:teuthology.orchestra.run.smithi043.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-06-13T11:34:55.832 INFO:teuthology.orchestra.run.smithi043.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-06-13T11:34:55.865 INFO:teuthology.orchestra.run.smithi053.stdout:(61/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-06-13T11:34:55.891 INFO:teuthology.orchestra.run.smithi043.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-06-13T11:34:55.941 INFO:teuthology.orchestra.run.smithi053.stdout:(62/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-06-13T11:34:55.958 INFO:teuthology.orchestra.run.smithi043.stdout:(129/160): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-06-13T11:34:55.983 INFO:teuthology.orchestra.run.smithi043.stdout:(130/160): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-06-13T11:34:56.008 INFO:teuthology.orchestra.run.smithi053.stdout:(63/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-06-13T11:34:56.034 INFO:teuthology.orchestra.run.smithi043.stdout:(131/160): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-06-13T11:34:56.059 INFO:teuthology.orchestra.run.smithi043.stdout:(132/160): python3-more-itertools-8.12.0-2.el9. 784 kB/s | 79 kB 00:00 2024-06-13T11:34:56.083 INFO:teuthology.orchestra.run.smithi053.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-06-13T11:34:56.084 INFO:teuthology.orchestra.run.smithi043.stdout:(133/160): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-06-13T11:34:56.108 INFO:teuthology.orchestra.run.smithi053.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 352 kB/s | 35 kB 00:00 2024-06-13T11:34:56.109 INFO:teuthology.orchestra.run.smithi043.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 329 kB/s | 16 kB 00:00 2024-06-13T11:34:56.134 INFO:teuthology.orchestra.run.smithi043.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-06-13T11:34:56.160 INFO:teuthology.orchestra.run.smithi043.stdout:(136/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-13T11:34:56.185 INFO:teuthology.orchestra.run.smithi043.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-06-13T11:34:56.210 INFO:teuthology.orchestra.run.smithi043.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-13T11:34:56.236 INFO:teuthology.orchestra.run.smithi043.stdout:(139/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-06-13T11:34:56.269 INFO:teuthology.orchestra.run.smithi043.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 607 kB/s | 36 kB 00:00 2024-06-13T11:34:56.295 INFO:teuthology.orchestra.run.smithi043.stdout:(141/160): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-06-13T11:34:56.320 INFO:teuthology.orchestra.run.smithi043.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 607 kB/s | 51 kB 00:00 2024-06-13T11:34:56.354 INFO:teuthology.orchestra.run.smithi043.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-06-13T11:34:56.379 INFO:teuthology.orchestra.run.smithi043.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-06-13T11:34:56.405 INFO:teuthology.orchestra.run.smithi043.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-06-13T11:34:56.430 INFO:teuthology.orchestra.run.smithi043.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-13T11:34:56.455 INFO:teuthology.orchestra.run.smithi043.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-06-13T11:34:56.467 INFO:teuthology.orchestra.run.smithi053.stdout:(66/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-06-13T11:34:56.514 INFO:teuthology.orchestra.run.smithi043.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-13T11:34:56.609 INFO:teuthology.orchestra.run.smithi053.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-13T11:34:56.684 INFO:teuthology.orchestra.run.smithi053.stdout:(68/160): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-06-13T11:34:56.722 INFO:teuthology.orchestra.run.smithi043.stdout:(149/160): NetworkManager-1.47.91-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-06-13T11:34:56.864 INFO:teuthology.orchestra.run.smithi043.stdout:(150/160): NetworkManager-libnm-1.47.91-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-06-13T11:34:56.923 INFO:teuthology.orchestra.run.smithi043.stdout:(151/160): librados2-19.0.0-2946.g3d89accf.el9. 6.9 MB/s | 3.4 MB 00:00 2024-06-13T11:34:56.956 INFO:teuthology.orchestra.run.smithi043.stdout:(152/160): NetworkManager-team-1.47.91-1.el9.x8 451 kB/s | 41 kB 00:00 2024-06-13T11:34:57.048 INFO:teuthology.orchestra.run.smithi043.stdout:(153/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-06-13T11:34:57.073 INFO:teuthology.orchestra.run.smithi043.stdout:(154/160): NetworkManager-tui-1.47.91-1.el9.x86 1.6 MB/s | 248 kB 00:00 2024-06-13T11:34:57.090 INFO:teuthology.orchestra.run.smithi043.stdout:(155/160): elfutils-debuginfod-client-0.191-4.e 274 kB/s | 37 kB 00:00 2024-06-13T11:34:57.110 INFO:teuthology.orchestra.run.smithi053.stdout:(69/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 7.1 MB/s | 48 MB 00:06 2024-06-13T11:34:57.143 INFO:teuthology.orchestra.run.smithi053.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 290 kB/s | 133 kB 00:00 2024-06-13T11:34:57.149 INFO:teuthology.orchestra.run.smithi043.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 2.0 MB/s | 207 kB 00:00 2024-06-13T11:34:57.191 INFO:teuthology.orchestra.run.smithi043.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 2.5 MB/s | 260 kB 00:00 2024-06-13T11:34:57.224 INFO:teuthology.orchestra.run.smithi043.stdout:(158/160): openssl-3.2.2-1.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-06-13T11:34:57.277 INFO:teuthology.orchestra.run.smithi053.stdout:(71/160): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-06-13T11:34:57.308 INFO:teuthology.orchestra.run.smithi043.stdout:(159/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-06-13T11:34:57.341 INFO:teuthology.orchestra.run.smithi043.stdout:(160/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 7.3 MB/s | 1.1 MB 00:00 2024-06-13T11:34:57.349 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:34:57.349 INFO:teuthology.orchestra.run.smithi043.stdout:Total 16 MB/s | 226 MB 00:14 2024-06-13T11:34:57.352 INFO:teuthology.orchestra.run.smithi053.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-06-13T11:34:57.769 INFO:teuthology.orchestra.run.smithi053.stdout:(73/160): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-06-13T11:34:57.836 INFO:teuthology.orchestra.run.smithi053.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 921 kB/s | 61 kB 00:00 2024-06-13T11:34:57.911 INFO:teuthology.orchestra.run.smithi053.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-06-13T11:34:57.978 INFO:teuthology.orchestra.run.smithi053.stdout:(76/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-06-13T11:34:58.037 INFO:teuthology.orchestra.run.smithi053.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-06-13T11:34:58.095 INFO:teuthology.orchestra.run.smithi053.stdout:(78/160): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-06-13T11:34:58.154 INFO:teuthology.orchestra.run.smithi053.stdout:(79/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-06-13T11:34:58.213 INFO:teuthology.orchestra.run.smithi053.stdout:(80/160): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-06-13T11:34:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:(81/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-06-13T11:34:58.611 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-06-13T11:34:58.622 INFO:teuthology.orchestra.run.smithi053.stdout:(82/160): openblas-openmp-0.3.21-2.el9.x86_64.r 1.9 MB/s | 4.7 MB 00:02 2024-06-13T11:34:58.656 INFO:teuthology.orchestra.run.smithi053.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-06-13T11:34:58.748 INFO:teuthology.orchestra.run.smithi053.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 841 kB/s | 77 kB 00:00 2024-06-13T11:34:58.806 INFO:teuthology.orchestra.run.smithi053.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-06-13T11:34:58.823 INFO:teuthology.orchestra.run.smithi053.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 562 kB/s | 42 kB 00:00 2024-06-13T11:34:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-06-13T11:34:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-06-13T11:34:58.882 INFO:teuthology.orchestra.run.smithi053.stdout:(87/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-06-13T11:34:58.941 INFO:teuthology.orchestra.run.smithi053.stdout:(88/160): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-06-13T11:34:58.991 INFO:teuthology.orchestra.run.smithi053.stdout:(89/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-13T11:34:59.016 INFO:teuthology.orchestra.run.smithi053.stdout:(90/160): python3-protobuf-3.14.0-13.el9.noarch 1.3 MB/s | 269 kB 00:00 2024-06-13T11:34:59.050 INFO:teuthology.orchestra.run.smithi053.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 916 kB/s | 54 kB 00:00 2024-06-13T11:34:59.108 INFO:teuthology.orchestra.run.smithi053.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-06-13T11:34:59.167 INFO:teuthology.orchestra.run.smithi053.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-06-13T11:34:59.226 INFO:teuthology.orchestra.run.smithi053.stdout:(94/160): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-06-13T11:34:59.285 INFO:teuthology.orchestra.run.smithi053.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-06-13T11:34:59.343 INFO:teuthology.orchestra.run.smithi053.stdout:(96/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-06-13T11:34:59.402 INFO:teuthology.orchestra.run.smithi053.stdout:(97/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-06-13T11:34:59.460 INFO:teuthology.orchestra.run.smithi053.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-06-13T11:34:59.519 INFO:teuthology.orchestra.run.smithi053.stdout:(99/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rpm 1.6 MB/s | 95 kB 00:00 2024-06-13T11:34:59.569 INFO:teuthology.orchestra.run.smithi053.stdout:(100/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-13T11:34:59.628 INFO:teuthology.orchestra.run.smithi053.stdout:(101/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-06-13T11:34:59.678 INFO:teuthology.orchestra.run.smithi053.stdout:(102/160): lua-devel-5.4.4-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2024-06-13T11:34:59.745 INFO:teuthology.orchestra.run.smithi053.stdout:(103/160): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-06-13T11:34:59.820 INFO:teuthology.orchestra.run.smithi053.stdout:(104/160): postgresql-server-13.14-1.el9.x86_64 2.1 MB/s | 5.8 MB 00:02 2024-06-13T11:34:59.929 INFO:teuthology.orchestra.run.smithi053.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 2.9 MB/s | 548 kB 00:00 2024-06-13T11:34:59.946 INFO:teuthology.orchestra.run.smithi053.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-06-13T11:34:59.971 INFO:teuthology.orchestra.run.smithi053.stdout:(107/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-06-13T11:34:59.997 INFO:teuthology.orchestra.run.smithi053.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-13T11:35:00.022 INFO:teuthology.orchestra.run.smithi053.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-13T11:35:00.047 INFO:teuthology.orchestra.run.smithi053.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-06-13T11:35:00.073 INFO:teuthology.orchestra.run.smithi053.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-06-13T11:35:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-06-13T11:35:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-06-13T11:35:00.182 INFO:teuthology.orchestra.run.smithi053.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-13T11:35:00.207 INFO:teuthology.orchestra.run.smithi053.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-13T11:35:00.233 INFO:teuthology.orchestra.run.smithi053.stdout:(116/160): python3-certifi-2021.10.8-2.el9.noar 601 kB/s | 15 kB 00:00 2024-06-13T11:35:00.266 INFO:teuthology.orchestra.run.smithi053.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-06-13T11:35:00.300 INFO:teuthology.orchestra.run.smithi053.stdout:(118/160): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-06-13T11:35:00.334 INFO:teuthology.orchestra.run.smithi053.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-06-13T11:35:00.359 INFO:teuthology.orchestra.run.smithi053.stdout:(120/160): python3-google-auth-2.29.0-2.el9.noa 8.0 MB/s | 205 kB 00:00 2024-06-13T11:35:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:(121/160): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-06-13T11:35:00.451 INFO:teuthology.orchestra.run.smithi053.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-06-13T11:35:00.476 INFO:teuthology.orchestra.run.smithi053.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-06-13T11:35:00.502 INFO:teuthology.orchestra.run.smithi053.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-06-13T11:35:00.527 INFO:teuthology.orchestra.run.smithi053.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-06-13T11:35:00.552 INFO:teuthology.orchestra.run.smithi053.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-06-13T11:35:00.578 INFO:teuthology.orchestra.run.smithi053.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-06-13T11:35:00.628 INFO:teuthology.orchestra.run.smithi053.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-06-13T11:35:00.678 INFO:teuthology.orchestra.run.smithi053.stdout:(129/160): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-06-13T11:35:00.704 INFO:teuthology.orchestra.run.smithi053.stdout:(130/160): python3-logutils-0.3.5-21.el9.noarch 614 kB/s | 46 kB 00:00 2024-06-13T11:35:00.729 INFO:teuthology.orchestra.run.smithi053.stdout:(131/160): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-06-13T11:35:00.754 INFO:teuthology.orchestra.run.smithi053.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-06-13T11:35:00.780 INFO:teuthology.orchestra.run.smithi053.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-06-13T11:35:00.805 INFO:teuthology.orchestra.run.smithi053.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-06-13T11:35:00.830 INFO:teuthology.orchestra.run.smithi053.stdout:(135/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-06-13T11:35:00.856 INFO:teuthology.orchestra.run.smithi053.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 558 kB/s | 28 kB 00:00 2024-06-13T11:35:00.872 INFO:teuthology.orchestra.run.smithi053.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-06-13T11:35:00.889 INFO:teuthology.orchestra.run.smithi053.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-06-13T11:35:00.915 INFO:teuthology.orchestra.run.smithi053.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-06-13T11:35:00.931 INFO:teuthology.orchestra.run.smithi053.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-06-13T11:35:00.948 INFO:teuthology.orchestra.run.smithi053.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 3.0 MB/s | 51 kB 00:00 2024-06-13T11:35:00.974 INFO:teuthology.orchestra.run.smithi053.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-06-13T11:35:00.999 INFO:teuthology.orchestra.run.smithi053.stdout:(143/160): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-06-13T11:35:01.024 INFO:teuthology.orchestra.run.smithi053.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-06-13T11:35:01.050 INFO:teuthology.orchestra.run.smithi053.stdout:(145/160): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-06-13T11:35:01.059 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-06-13T11:35:01.060 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-06-13T11:35:01.075 INFO:teuthology.orchestra.run.smithi053.stdout:(146/160): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-06-13T11:35:01.142 INFO:teuthology.orchestra.run.smithi053.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-06-13T11:35:01.434 INFO:teuthology.orchestra.run.smithi053.stdout:(148/160): librados2-19.0.0-2946.g3d89accf.el9. 9.4 MB/s | 3.4 MB 00:00 2024-06-13T11:35:01.601 INFO:teuthology.orchestra.run.smithi053.stdout:(149/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 6.8 MB/s | 3.1 MB 00:00 2024-06-13T11:35:01.751 INFO:teuthology.orchestra.run.smithi053.stdout:(150/160): NetworkManager-1.47.91-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-06-13T11:35:01.802 INFO:teuthology.orchestra.run.smithi053.stdout:(151/160): NetworkManager-team-1.47.91-1.el9.x8 829 kB/s | 41 kB 00:00 2024-06-13T11:35:01.852 INFO:teuthology.orchestra.run.smithi053.stdout:(152/160): NetworkManager-tui-1.47.91-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-06-13T11:35:01.910 INFO:teuthology.orchestra.run.smithi053.stdout:(153/160): NetworkManager-libnm-1.47.91-1.el9.x 5.8 MB/s | 1.8 MB 00:00 2024-06-13T11:35:01.936 INFO:teuthology.orchestra.run.smithi053.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 440 kB/s | 37 kB 00:00 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi053.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 4.0 MB/s | 207 kB 00:00 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi053.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.0 MB/s | 260 kB 00:00 2024-06-13T11:35:02.045 INFO:teuthology.orchestra.run.smithi053.stdout:(157/160): openssl-3.2.2-1.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-06-13T11:35:02.104 INFO:teuthology.orchestra.run.smithi053.stdout:(158/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-06-13T11:35:02.146 INFO:teuthology.orchestra.run.smithi053.stdout:(159/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-06-13T11:35:07.727 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-06-13T11:35:07.821 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T11:35:07.870 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T11:35:07.939 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T11:35:07.981 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T11:35:08.006 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T11:35:08.052 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T11:35:08.452 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T11:35:08.506 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:35:08.622 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:35:08.649 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:35:08.742 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:35:08.771 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:35:08.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T11:35:08.871 INFO:teuthology.orchestra.run.smithi053.stdout:(160/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.6 MB/s | 16 MB 00:09 2024-06-13T11:35:08.876 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:35:08.876 INFO:teuthology.orchestra.run.smithi053.stdout:Total 9.3 MB/s | 226 MB 00:24 2024-06-13T11:35:09.017 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T11:35:09.079 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T11:35:09.105 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:35:09.211 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:35:09.239 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:35:09.302 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:35:09.324 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:35:09.347 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:35:09.542 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:35:09.646 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:35:09.907 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T11:35:10.074 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:35:10.126 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:35:10.148 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-06-13T11:35:10.226 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:35:10.319 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-06-13T11:35:10.523 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:35:10.637 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T11:35:10.731 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T11:35:10.766 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T11:35:10.801 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T11:35:10.877 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T11:35:10.918 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T11:35:10.961 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T11:35:10.993 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T11:35:11.021 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T11:35:11.093 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T11:35:11.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T11:35:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T11:35:11.243 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T11:35:11.321 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T11:35:11.353 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T11:35:11.398 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T11:35:11.425 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T11:35:11.499 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T11:35:11.540 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T11:35:11.617 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T11:35:11.765 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T11:35:11.818 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T11:35:12.379 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T11:35:12.474 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T11:35:12.509 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T11:35:12.546 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T11:35:12.595 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T11:35:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-06-13T11:35:12.630 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-06-13T11:35:12.632 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T11:35:12.675 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T11:35:12.842 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T11:35:12.893 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T11:35:12.952 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T11:35:13.026 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T11:35:13.071 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T11:35:13.108 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T11:35:13.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T11:35:13.276 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T11:35:13.419 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T11:35:13.603 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T11:35:13.645 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T11:35:13.743 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T11:35:13.794 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T11:35:13.835 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T11:35:13.867 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T11:35:13.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T11:35:13.992 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T11:35:14.123 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T11:35:14.166 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T11:35:14.193 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T11:35:14.237 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T11:35:14.276 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T11:35:14.316 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T11:35:14.345 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T11:35:14.380 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T11:35:14.414 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T11:35:14.455 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T11:35:14.489 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T11:35:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T11:35:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T11:35:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T11:35:14.715 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T11:35:14.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T11:35:14.887 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:35:15.661 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T11:35:15.708 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T11:35:15.742 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T11:35:15.846 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T11:35:15.946 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T11:35:16.033 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T11:35:16.078 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T11:35:16.261 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T11:35:16.300 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T11:35:16.381 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T11:35:17.078 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T11:35:17.203 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T11:35:18.523 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T11:35:18.673 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T11:35:19.003 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T11:35:19.052 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:35:19.135 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:35:19.166 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T11:35:19.210 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T11:35:19.402 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-06-13T11:35:19.484 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T11:35:19.526 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T11:35:19.599 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T11:35:19.643 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T11:35:19.676 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T11:35:19.708 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T11:35:19.722 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T11:35:19.739 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:35:19.810 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:35:19.832 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T11:35:20.077 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T11:35:20.186 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:35:20.311 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:35:20.337 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:35:20.430 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:35:20.458 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:35:20.504 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T11:35:20.702 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T11:35:20.882 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T11:35:20.909 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:35:20.998 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:35:21.027 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:35:21.090 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:35:21.111 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:35:21.133 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:35:21.458 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:35:21.550 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:35:21.777 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T11:35:21.920 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:35:21.980 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:35:22.099 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:35:22.190 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:35:22.190 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:35:22.229 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:35:22.393 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:35:22.507 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T11:35:22.603 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T11:35:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T11:35:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T11:35:22.756 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T11:35:22.796 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T11:35:22.800 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:35:22.840 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T11:35:22.841 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:35:22.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T11:35:22.900 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T11:35:22.949 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:35:22.949 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T11:35:22.949 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T11:35:22.949 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:22.971 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T11:35:22.983 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:35:23.032 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T11:35:23.062 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T11:35:23.105 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T11:35:23.184 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T11:35:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T11:35:23.251 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T11:35:23.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T11:35:23.353 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T11:35:23.528 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T11:35:23.605 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T11:35:23.753 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T11:35:23.816 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T11:35:24.373 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T11:35:24.462 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T11:35:24.497 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T11:35:24.538 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T11:35:24.582 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T11:35:24.620 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T11:35:24.662 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T11:35:24.818 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T11:35:24.881 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T11:35:24.937 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T11:35:25.012 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T11:35:25.048 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T11:35:25.085 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T11:35:25.132 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T11:35:25.168 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T11:35:25.211 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T11:35:25.253 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T11:35:25.397 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T11:35:25.440 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T11:35:25.482 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T11:35:25.581 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T11:35:25.614 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T11:35:25.664 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T11:35:25.696 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T11:35:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T11:35:25.811 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T11:35:25.947 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T11:35:25.979 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T11:35:26.007 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T11:35:26.040 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T11:35:26.081 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T11:35:26.121 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T11:35:26.150 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T11:35:26.185 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T11:35:26.218 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T11:35:26.260 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T11:35:26.294 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T11:35:26.384 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T11:35:26.426 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T11:35:26.456 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T11:35:26.504 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T11:35:26.616 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T11:35:26.667 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:35:27.429 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T11:35:27.480 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T11:35:27.514 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T11:35:27.634 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T11:35:27.695 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T11:35:27.741 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T11:35:27.830 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T11:35:27.867 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T11:35:28.052 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T11:35:28.072 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T11:35:28.145 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T11:35:28.845 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T11:35:28.968 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T11:35:30.306 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T11:35:30.394 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T11:35:30.421 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T11:35:30.464 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T11:35:30.792 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T11:35:30.834 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:35:30.926 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:35:30.956 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T11:35:30.993 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T11:35:31.491 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T11:35:31.521 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:35:31.592 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:35:31.623 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T11:35:34.016 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:35:34.053 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:35:34.633 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:35:34.664 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:35:34.757 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:35:34.757 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T11:35:34.757 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T11:35:34.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:34.791 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:35:35.046 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:35:35.046 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-06-13T11:35:35.047 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:35.214 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:35:35.232 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:35:35.232 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:35.232 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T11:35:35.232 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:36.759 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:35:36.786 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:35:36.787 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:36.787 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T11:35:36.787 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:35:36.787 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:35:36.787 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:37.017 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:35:37.042 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:35:37.042 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:37.042 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T11:35:37.042 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:35:37.042 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:35:37.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:37.526 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:35:37.551 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:35:37.551 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:37.551 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T11:35:37.551 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:35:37.552 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:35:37.552 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:37.658 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T11:35:37.716 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T11:35:37.780 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T11:35:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T11:35:38.028 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T11:35:38.109 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T11:35:38.209 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T11:35:38.358 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T11:35:38.403 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T11:35:38.435 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T11:35:38.462 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T11:35:38.993 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:35:39.019 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:35:39.051 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T11:35:39.120 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T11:35:39.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:35:40.239 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:35:40.284 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:35:41.298 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:35:41.317 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:35:41.426 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:35:41.595 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T11:35:41.628 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:35:41.652 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:35:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T11:35:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:35:41.653 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:35:41.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:41.703 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:35:41.715 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:35:41.816 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T11:35:41.873 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T11:35:42.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T11:35:42.839 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:35:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:35:42.864 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:42.864 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T11:35:42.864 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:35:42.864 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:35:42.864 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:42.906 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:35:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:35:42.930 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:42.930 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T11:35:42.930 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:42.982 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:35:43.006 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:35:43.006 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:43.006 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T11:35:43.007 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:35:43.007 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:35:43.007 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:43.332 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:35:43.357 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:35:43.357 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:43.357 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T11:35:43.357 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:35:43.358 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:35:43.358 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:46.591 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:35:46.591 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-06-13T11:35:46.591 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-06-13T11:35:46.591 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-06-13T11:35:46.591 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-06-13T11:35:46.592 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-06-13T11:35:46.592 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-06-13T11:35:46.592 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-06-13T11:35:46.592 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:46.756 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:35:46.772 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:35:46.772 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:46.772 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T11:35:46.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:48.128 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T11:35:48.170 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T11:35:48.211 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T11:35:48.242 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T11:35:48.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T11:35:48.309 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:35:48.337 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:35:48.337 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:48.337 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T11:35:48.337 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:35:48.337 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:35:48.337 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:48.472 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:35:48.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T11:35:48.548 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T11:35:48.569 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:35:48.579 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T11:35:48.593 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:35:48.593 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:48.593 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T11:35:48.593 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:35:48.593 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:35:48.593 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:48.617 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:35:48.663 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T11:35:49.062 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:35:49.086 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:35:49.086 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:49.086 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T11:35:49.086 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:35:49.086 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:35:49.086 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:49.202 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T11:35:49.259 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T11:35:49.324 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T11:35:49.333 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:35:49.378 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:35:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:35:49.519 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T11:35:49.564 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T11:35:49.645 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T11:35:49.745 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T11:35:49.884 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T11:35:49.931 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T11:35:49.963 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T11:35:49.994 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T11:35:50.306 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T11:35:50.391 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T11:35:50.434 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T11:35:50.457 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:35:50.483 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:35:50.515 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T11:35:50.527 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T11:35:50.561 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T11:35:50.579 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T11:35:50.585 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T11:35:50.606 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:35:50.611 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:35:50.637 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T11:35:50.637 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:35:50.730 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:35:50.772 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T11:35:50.772 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:35:50.857 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:35:50.881 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T11:35:50.891 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:35:50.891 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:35:51.083 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:35:51.083 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:35:51.168 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:35:51.200 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:35:51.242 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T11:35:51.320 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:35:51.695 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:35:51.733 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:35:52.749 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:35:52.775 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:35:52.884 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:35:53.054 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T11:35:53.085 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:35:53.110 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:35:53.110 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:53.110 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T11:35:53.110 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:35:53.110 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:35:53.110 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:53.161 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:35:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:35:53.282 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T11:35:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T11:35:54.293 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T11:35:54.322 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:35:54.347 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:35:54.347 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:54.347 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T11:35:54.347 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:35:54.347 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:35:54.347 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:54.389 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:35:54.413 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:35:54.413 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:54.413 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T11:35:54.413 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:54.465 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:35:54.489 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:35:54.489 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:54.489 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T11:35:54.490 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:35:54.490 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:35:54.490 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:35:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:35:54.832 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:35:54.832 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T11:35:54.832 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:35:54.832 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:35:54.832 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:35:56.750 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:35:56.750 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T11:35:56.750 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T11:35:56.750 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T11:35:56.750 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T11:35:56.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T11:35:56.752 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T11:35:56.765 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T11:35:56.766 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T11:35:56.767 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T11:35:56.768 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T11:35:56.769 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T11:35:56.770 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T11:35:56.771 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T11:35:56.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T11:35:56.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T11:35:56.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T11:35:56.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:35:56.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T11:35:59.353 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.354 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.355 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.356 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T11:35:59.357 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T11:35:59.358 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T11:35:59.359 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T11:35:59.361 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T11:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T11:35:59.363 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T11:35:59.364 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T11:35:59.365 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T11:35:59.366 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:35:59.367 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:35:59.368 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-06-13T11:35:59.619 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T11:35:59.670 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T11:35:59.710 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T11:35:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T11:35:59.760 DEBUG:teuthology.parallel:result is None 2024-06-13T11:35:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T11:35:59.966 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:36:00.006 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T11:36:00.039 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T11:36:00.079 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T11:36:00.109 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:36:00.146 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T11:36:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:36:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:36:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:36:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T11:36:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T11:36:01.865 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T11:36:01.967 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T11:36:02.001 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T11:36:02.026 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T11:36:02.051 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:36:02.078 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T11:36:02.078 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:36:02.163 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:36:02.195 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T11:36:02.195 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:36:02.305 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:36:02.330 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T11:36:02.336 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:36:02.336 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:36:02.523 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:36:02.523 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:36:02.616 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:36:02.640 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:36:02.672 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T11:36:02.744 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:36:08.231 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:36:08.231 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T11:36:08.231 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T11:36:08.232 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T11:36:08.233 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T11:36:08.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T11:36:08.235 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T11:36:08.236 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T11:36:08.237 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T11:36:08.238 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T11:36:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T11:36:08.240 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T11:36:08.241 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T11:36:08.242 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T11:36:08.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T11:36:08.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T11:36:08.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T11:36:08.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T11:36:08.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:36:08.244 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T11:36:11.323 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.324 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.325 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.326 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T11:36:11.327 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.328 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T11:36:11.329 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T11:36:11.330 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T11:36:11.331 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T11:36:11.332 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T11:36:11.333 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T11:36:11.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T11:36:11.335 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.336 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T11:36:11.337 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T11:36:11.338 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T11:36:11.338 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:11.338 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-06-13T11:36:11.872 DEBUG:teuthology.parallel:result is None 2024-06-13T11:36:11.872 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:36:12.013 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T11:36:12.040 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T11:36:12.041 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T11:36:12.041 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T11:36:12.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:36:12.187 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T11:36:12.214 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T11:36:12.214 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T11:36:12.214 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T11:36:12.216 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-13T11:36:12.216 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:12.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T11:36:12.250 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:12.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T11:36:12.287 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-13T11:36:12.287 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:12.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T11:36:12.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T11:36:12.390 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:12.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T11:36:12.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T11:36:12.491 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-13T11:36:12.491 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:12.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T11:36:12.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T11:36:12.591 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:12.591 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T11:36:12.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T11:36:12.691 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-13T11:36:12.691 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:12.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T11:36:12.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T11:36:12.783 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:12.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T11:36:12.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T11:36:12.880 INFO:teuthology.run_tasks:Running task ceph... 2024-06-13T11:36:12.956 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-13T11:36:12.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-06-13T11:36:12.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-06-13T11:36:12.987 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-13T11:36:12.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-13T11:36:13.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-13T11:36:13.058 INFO:tasks.ceph:Creating extra log directories... 2024-06-13T11:36:13.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-13T11:36:13.095 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-13T11:36:13.133 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-06-13T11:36:13.134 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-06-13T11:36:13.134 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-06-13T11:36:13.134 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:13.134 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-13T11:36:13.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-13T11:36:13.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-13T11:36:13.328 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:13.328 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-13T11:36:13.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-13T11:36:13.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-13T11:36:13.504 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-13T11:36:13.504 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-13T11:36:13.504 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752863', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7752863', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '1373963c202323287783ccb099bbae1ec8f14a5d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8815, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'sleep_before_teardown': 0, 'subset': '250/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1373963c202323287783ccb099bbae1ec8f14a5d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIBv6QXoldc8S+NFHr80poj50N4vsBjg1eoxnAKs5XI7m0MZlGL4t508pLuYB8W2qQITzwASIZ4QTftX0O8aGE=', 'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwI82qfIyyiEuTRkVUL5V4Q1/OJ/36BuDg5EeuvsJeHbi1WuD9vrVpUDkc8pXo8uVnJHYgssu4CSpjcBXpde9I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c1b06c2b5d3a02a3583265a115f09e052855bcf2', 'timestamp': '2024-06-12_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-13T11:36:13.505 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-13T11:36:13.507 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-13T11:36:13.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-06-13T11:36:13.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-06-13T11:36:13.627 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:13.627 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T11:36:13.643 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T11:36:13.643 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-06-13T11:36:13.699 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T11:36:13.699 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:13.699 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 673 Links: 1 2024-06-13T11:36:13.699 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:13.699 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:13.699 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-06-13 11:35:51.669299674 +0000 2024-06-13T11:36:13.700 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-06-13 11:33:40.933964644 +0000 2024-06-13T11:36:13.700 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-06-13 11:33:40.933964644 +0000 2024-06-13T11:36:13.700 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-06-13 11:33:40.933964644 +0000 2024-06-13T11:36:13.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T11:36:13.763 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-06-13T11:36:13.764 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-06-13T11:36:13.764 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 8.6735e-05 s, 5.9 MB/s 2024-06-13T11:36:13.765 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T11:36:13.822 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-06-13T11:36:13.877 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 695 Links: 1 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-06-13 11:35:51.669299674 +0000 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-06-13 11:33:41.255960868 +0000 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-06-13 11:33:41.255960868 +0000 2024-06-13T11:36:13.878 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-06-13 11:33:41.255960868 +0000 2024-06-13T11:36:13.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T11:36:13.941 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-06-13T11:36:13.941 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-06-13T11:36:13.942 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000101481 s, 5.0 MB/s 2024-06-13T11:36:13.943 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T11:36:13.999 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 712 Links: 1 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-06-13 11:35:51.670299662 +0000 2024-06-13T11:36:14.055 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-06-13 11:33:41.577957091 +0000 2024-06-13T11:36:14.056 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-06-13 11:33:41.577957091 +0000 2024-06-13T11:36:14.056 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-06-13 11:33:41.577957091 +0000 2024-06-13T11:36:14.056 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T11:36:14.119 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-06-13T11:36:14.119 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-06-13T11:36:14.119 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000100254 s, 5.1 MB/s 2024-06-13T11:36:14.121 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T11:36:14.177 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-06-13T11:36:14.233 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T11:36:14.233 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:14.233 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 730 Links: 1 2024-06-13T11:36:14.233 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:14.233 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-06-13 11:35:51.670299662 +0000 2024-06-13T11:36:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-06-13 11:33:41.897953339 +0000 2024-06-13T11:36:14.234 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-06-13 11:33:41.897953339 +0000 2024-06-13T11:36:14.234 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-06-13 11:33:41.897953339 +0000 2024-06-13T11:36:14.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T11:36:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-06-13T11:36:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-06-13T11:36:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 9.2908e-05 s, 5.5 MB/s 2024-06-13T11:36:14.299 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T11:36:14.357 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:14.357 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:14.357 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T11:36:14.377 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T11:36:14.377 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-06-13 11:36:03.096249830 +0000 2024-06-13T11:36:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-06-13 11:33:40.933112687 +0000 2024-06-13T11:36:14.438 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-06-13 11:33:40.933112687 +0000 2024-06-13T11:36:14.438 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-06-13 11:33:40.933112687 +0000 2024-06-13T11:36:14.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T11:36:14.505 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-06-13T11:36:14.505 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-06-13T11:36:14.505 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000114922 s, 4.5 MB/s 2024-06-13T11:36:14.507 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T11:36:14.565 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-06-13 11:36:03.097249812 +0000 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-06-13 11:33:41.268106408 +0000 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-06-13 11:33:41.268106408 +0000 2024-06-13T11:36:14.623 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-06-13 11:33:41.268106408 +0000 2024-06-13T11:36:14.624 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T11:36:14.689 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-06-13T11:36:14.689 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-06-13T11:36:14.689 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000107675 s, 4.8 MB/s 2024-06-13T11:36:14.690 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T11:36:14.748 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-06-13T11:36:14.805 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T11:36:14.805 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:14.805 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-06-13T11:36:14.806 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:14.806 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:14.806 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-06-13 11:36:03.097249812 +0000 2024-06-13T11:36:14.806 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-06-13 11:33:41.603100130 +0000 2024-06-13T11:36:14.806 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-06-13 11:33:41.603100130 +0000 2024-06-13T11:36:14.806 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-06-13 11:33:41.603100130 +0000 2024-06-13T11:36:14.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T11:36:14.871 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-06-13T11:36:14.871 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-06-13T11:36:14.871 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000105109 s, 4.9 MB/s 2024-06-13T11:36:14.872 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T11:36:14.930 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-06-13 11:36:03.097249812 +0000 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-06-13 11:33:41.927094057 +0000 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-06-13 11:33:41.927094057 +0000 2024-06-13T11:36:14.988 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-06-13 11:33:41.927094057 +0000 2024-06-13T11:36:14.988 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T11:36:15.052 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-06-13T11:36:15.053 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-06-13T11:36:15.053 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.2611e-05 s, 6.2 MB/s 2024-06-13T11:36:15.054 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T11:36:15.114 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:15.114 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-13T11:36:15.114 INFO:tasks.ceph:Generating config... 2024-06-13T11:36:15.116 INFO:tasks.ceph:[client] client mount timeout = 600 2024-06-13T11:36:15.116 INFO:tasks.ceph:[client] debug client = 20 2024-06-13T11:36:15.116 INFO:tasks.ceph:[client] debug ms = 1 2024-06-13T11:36:15.116 INFO:tasks.ceph:[client] pid file = 2024-06-13T11:36:15.116 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-06-13T11:36:15.116 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-06-13T11:36:15.116 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-06-13T11:36:15.116 INFO:tasks.ceph:[mds] debug mds = 20 2024-06-13T11:36:15.116 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-06-13T11:36:15.116 INFO:tasks.ceph:[mds] debug ms = 1 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] mds debug frag = True 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mgr] debug client = 20 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-06-13T11:36:15.117 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-06-13T11:36:15.117 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-13T11:36:15.118 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-06-13T11:36:15.118 INFO:tasks.ceph:Setting up mon.a... 2024-06-13T11:36:15.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-13T11:36:15.176 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-06-13T11:36:15.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-13T11:36:15.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-13T11:36:15.253 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '172.21.15.53'), ('mon.c', '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]')] 2024-06-13T11:36:15.254 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-06-13T11:36:15.254 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:15.254 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-13T11:36:15.310 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --add b 172.21.15.53 --addv c '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5 2024-06-13T11:36:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-06-13T11:36:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-06-13T11:36:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5 2024-06-13T11:36:15.399 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-06-13T11:36:15.401475+0000 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-06-13T11:36:15.401475+0000 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.b 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] mon.c 2024-06-13T11:36:15.400 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-13T11:36:15.401 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-13T11:36:15.417 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5... 2024-06-13T11:36:15.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-13T11:36:15.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-13T11:36:15.501 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-06-13T11:36:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-06-13T11:36:15.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-06-13T11:36:15.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-13T11:36:15.504 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]" 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-06-13T11:36:15.505 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.506 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-06-13T11:36:15.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 20 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 20 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-06-13T11:36:15.508 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 10 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-06-13T11:36:15.509 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-06-13T11:36:15.510 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-13T11:36:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: mon op complaint time = 120 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-13T11:36:15.512 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout: client mount timeout = 600 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-06-13T11:36:15.513 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds = 20 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds balancer = 20 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug frag = True 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = True 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: mds op complaint time = 180 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = True 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2024-06-13T11:36:15.514 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-06-13T11:36:15.515 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-06-13T11:36:15.516 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.517 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.43,172.21.15.53,[v2:172.21.15.53:3301,v1:172.21.15.53:6790]" 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on skipped message = False 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.518 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-06-13T11:36:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 20 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 20 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 10 2024-06-13T11:36:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-06-13T11:36:15.522 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-06-13T11:36:15.523 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.524 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: mon down mkfs grace = 300 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-06-13T11:36:15.525 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = "" 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2024-06-13T11:36:15.526 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2024-06-13T11:36:15.527 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2024-06-13T11:36:15.529 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-13T11:36:15.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-13T11:36:15.624 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-13T11:36:15.624 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:15.624 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-13T11:36:15.640 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:15.640 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-13T11:36:15.695 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:36:15.695 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:15.696 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-13T11:36:15.696 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-13T11:36:15.771 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:15.771 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:15.827 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:36:15.827 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:15.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-13T11:36:15.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-13T11:36:15.871 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:15.871 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:15.929 INFO:tasks.ceph:Setting up mon nodes... 2024-06-13T11:36:15.930 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-13T11:36:15.930 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-13T11:36:15.982 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-13T11:36:15.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-13T11:36:16.057 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-13T11:36:16.060 INFO:tasks.ceph:Setting up mds nodes... 2024-06-13T11:36:16.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-06-13T11:36:16.112 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-06-13T11:36:16.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-06-13T11:36:16.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-06-13T11:36:16.233 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-06-13T11:36:16.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-06-13T11:36:16.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-06-13T11:36:16.322 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-06-13T11:36:16.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-06-13T11:36:16.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-06-13T11:36:16.449 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-06-13T11:36:16.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-06-13T11:36:16.479 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-13T11:36:16.479 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-13T11:36:16.521 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-13T11:36:16.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-06-13T11:36:16.617 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-06-13T11:36:16.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-13T11:36:16.674 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-13T11:36:16.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-06-13T11:36:16.770 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-06-13T11:36:16.783 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-13T11:36:16.783 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-13T11:36:16.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-13T11:36:16.809 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:16.809 INFO:tasks.ceph:role: osd.0 2024-06-13T11:36:16.809 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:36:16.809 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-13T11:36:16.874 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:16.874 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:16.874 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:16.875 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:16.906 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-06-13T11:36:16.908 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-06-13T11:36:16.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-13T11:36:16.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-13T11:36:17.049 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-13T11:36:17.116 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:17.116 INFO:tasks.ceph:role: osd.1 2024-06-13T11:36:17.116 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:36:17.116 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-13T11:36:17.181 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:17.181 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:17.181 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:17.181 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:17.181 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:17.182 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:17.182 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:17.182 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:17.182 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:17.182 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:17.215 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-06-13T11:36:17.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-06-13T11:36:17.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-13T11:36:17.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-13T11:36:17.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-13T11:36:17.422 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:17.422 INFO:tasks.ceph:role: osd.2 2024-06-13T11:36:17.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:36:17.423 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-13T11:36:17.488 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:17.488 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:17.489 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:17.523 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-06-13T11:36:17.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-06-13T11:36:17.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-13T11:36:17.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-13T11:36:17.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-13T11:36:17.728 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:17.728 INFO:tasks.ceph:role: osd.3 2024-06-13T11:36:17.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:36:17.728 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:17.793 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:17.794 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:17.825 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-06-13T11:36:17.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-06-13T11:36:17.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-13T11:36:17.897 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-13T11:36:17.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:18.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:18.066+0000 7fe156e14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-13T11:36:18.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:18.066+0000 7fe156e14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-13T11:36:18.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:18.066+0000 7fe156e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-13T11:36:18.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:18.066+0000 7fe156e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-13T11:36:18.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:18.066+0000 7fe156e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-13T11:36:18.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:18.066+0000 7fe156e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-13T11:36:20.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-13T11:36:20.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:21.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:21.036+0000 7f4a86e15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-13T11:36:21.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:21.036+0000 7f4a86e15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-13T11:36:21.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:21.036+0000 7f4a86e15640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-13T11:36:21.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:21.036+0000 7f4a86e15640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-13T11:36:21.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:21.036+0000 7f4a86e15640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-13T11:36:21.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:21.037+0000 7f4a86e15640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-13T11:36:23.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-13T11:36:23.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:24.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:24.013+0000 7fcdaf03d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-13T11:36:24.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:24.013+0000 7fcdaf03d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-13T11:36:24.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:24.013+0000 7fcdaf03d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-13T11:36:24.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:24.013+0000 7fcdaf03d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-13T11:36:24.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:24.013+0000 7fcdaf03d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-13T11:36:24.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:24.014+0000 7fcdaf03d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-13T11:36:26.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-13T11:36:26.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:26.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:26.983+0000 7f4cf8144640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-13T11:36:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:26.983+0000 7f4cf8144640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-13T11:36:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:26.983+0000 7f4cf8144640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-13T11:36:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:26.983+0000 7f4cf8144640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-13T11:36:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:26.983+0000 7f4cf8144640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-13T11:36:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:26.984+0000 7f4cf8144640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-13T11:36:29.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-13T11:36:29.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-13T11:36:29.902 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:29.902 INFO:tasks.ceph:role: osd.4 2024-06-13T11:36:29.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:36:29.903 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:29.973 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:29.974 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:29.974 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:30.005 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-06-13T11:36:30.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-06-13T11:36:30.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-13T11:36:30.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-13T11:36:30.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-13T11:36:30.221 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:30.222 INFO:tasks.ceph:role: osd.5 2024-06-13T11:36:30.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:36:30.222 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:30.287 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:30.319 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-06-13T11:36:30.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-06-13T11:36:30.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-13T11:36:30.391 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-13T11:36:30.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-13T11:36:30.528 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:30.528 INFO:tasks.ceph:role: osd.6 2024-06-13T11:36:30.528 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:36:30.528 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:30.595 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:30.627 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-06-13T11:36:30.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-06-13T11:36:30.629 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-13T11:36:30.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-13T11:36:30.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-13T11:36:30.833 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-13T11:36:30.833 INFO:tasks.ceph:role: osd.7 2024-06-13T11:36:30.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:36:30.833 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-13T11:36:30.899 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-13T11:36:30.900 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-13T11:36:30.933 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-06-13T11:36:30.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-06-13T11:36:30.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-13T11:36:31.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-13T11:36:31.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:31.172+0000 7f852a4d7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-13T11:36:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:31.172+0000 7f852a4d7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-13T11:36:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:31.172+0000 7f852a4d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-13T11:36:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:31.172+0000 7f852a4d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-13T11:36:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:31.172+0000 7f852a4d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-13T11:36:31.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:31.172+0000 7f852a4d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-13T11:36:34.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-13T11:36:34.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:34.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:34.148+0000 7fca28616640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-13T11:36:34.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:34.148+0000 7fca28616640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-13T11:36:34.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:34.148+0000 7fca28616640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-13T11:36:34.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:34.148+0000 7fca28616640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-13T11:36:34.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:34.148+0000 7fca28616640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-13T11:36:34.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:34.148+0000 7fca28616640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-13T11:36:37.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-13T11:36:37.033 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:37.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:37.129+0000 7fbc6a01c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-13T11:36:37.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:37.129+0000 7fbc6a01c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-13T11:36:37.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:37.129+0000 7fbc6a01c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-13T11:36:37.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:37.129+0000 7fbc6a01c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-13T11:36:37.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:37.129+0000 7fbc6a01c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-13T11:36:37.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:37.130+0000 7fbc6a01c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-13T11:36:39.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-13T11:36:40.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:40.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:40.095+0000 7effd09c0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-13T11:36:40.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:40.095+0000 7effd09c0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-13T11:36:40.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:40.095+0000 7effd09c0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-13T11:36:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:40.095+0000 7effd09c0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-13T11:36:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:40.095+0000 7effd09c0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-13T11:36:40.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:40.095+0000 7effd09c0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-13T11:36:42.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-13T11:36:42.979 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-13T11:36:42.979 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:42.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-13T11:36:43.010 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-06-13T11:36:43.081 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-06-13T11:36:43.150 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-13T11:36:43.219 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-13T11:36:43.287 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-13T11:36:43.356 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-13T11:36:43.424 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-13T11:36:43.455 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-06-13T11:36:43.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:36:43.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:36:43.527 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-06-13T11:36:43.595 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-13T11:36:43.662 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-13T11:36:43.729 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-13T11:36:43.796 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-13T11:36:43.863 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.863 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-13T11:36:43.882 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:43.882 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-06-13T11:36:43.942 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.942 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-13T11:36:43.958 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:43.958 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-06-13T11:36:44.014 INFO:tasks.ceph:Adding keys to all mons... 2024-06-13T11:36:44.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-13T11:36:44.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCv2WpmYECzOhAAzZmv/8bIOofDmzgwKdnQSQ== 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmaSPbBhAAbQv8H2shkFv1Qc92SHenpg== 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmnJ4JDhAAYE3roXV2yk69qFnL283UnQ== 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCy2WpmivMSBBAAv+ifDEjhacRuMVXqPu7Zxg== 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC12Wpm9YxIAhAAk71Mhrw7n3SudEr/XG1M0Q== 2024-06-13T11:36:44.058 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC42Wpmu2jrABAAf/roDhAfpWJCxejkY73BTQ== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC62WpmON28OhAAmmMvSRpOy02FoeNlZ/iALQ== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmEHyIAxAAU5IHH51kHZiueYQCNHbeIg== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2Wpmf6pWExAAmBs2G6jKAffXOyodDkuMFw== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmWjrxGhAABbGoGLtPBLRnVlW3FfLM0w== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC/2WpmK2hMChAArgIye7KKFXKxEdCH0tFfXg== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDC2Wpm6IngCBAAC7IlYfh6njQqqrLtoYoE6w== 2024-06-13T11:36:44.059 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDF2Wpm2cHEBxAAoW46zMF4QiQCaGfVIUBeJA== 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDI2WpmA/q5BRAAXToZ019G5FcWSdbxyGJT/w== 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmIeYsHxAA/BvB+aniAfk6a2V9mayvuw== 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:[client.2] 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmNtzwJBAA9t09ECKCJlTXWGr6/eMgWA== 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:[client.1] 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmTElSKBAAGejyWWSxxhh+klYXn8tgrQ== 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout:[client.3] 2024-06-13T11:36:44.060 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmXqEGLhAAYNH72mp9KVcSotncrIJGWQ== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCv2WpmYECzOhAAzZmv/8bIOofDmzgwKdnQSQ== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmaSPbBhAAbQv8H2shkFv1Qc92SHenpg== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmnJ4JDhAAYE3roXV2yk69qFnL283UnQ== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCy2WpmivMSBBAAv+ifDEjhacRuMVXqPu7Zxg== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQC12Wpm9YxIAhAAk71Mhrw7n3SudEr/XG1M0Q== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQC42Wpmu2jrABAAf/roDhAfpWJCxejkY73BTQ== 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-06-13T11:36:44.079 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQC62WpmON28OhAAmmMvSRpOy02FoeNlZ/iALQ== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmEHyIAxAAU5IHH51kHZiueYQCNHbeIg== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2Wpmf6pWExAAmBs2G6jKAffXOyodDkuMFw== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmWjrxGhAABbGoGLtPBLRnVlW3FfLM0w== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQC/2WpmK2hMChAArgIye7KKFXKxEdCH0tFfXg== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDC2Wpm6IngCBAAC7IlYfh6njQqqrLtoYoE6w== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDF2Wpm2cHEBxAAoW46zMF4QiQCaGfVIUBeJA== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDI2WpmA/q5BRAAXToZ019G5FcWSdbxyGJT/w== 2024-06-13T11:36:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmIeYsHxAA/BvB+aniAfk6a2V9mayvuw== 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout:[client.2] 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmNtzwJBAA9t09ECKCJlTXWGr6/eMgWA== 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmTElSKBAAGejyWWSxxhh+klYXn8tgrQ== 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout:[client.3] 2024-06-13T11:36:44.081 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCw2WpmXqEGLhAAYNH72mp9KVcSotncrIJGWQ== 2024-06-13T11:36:44.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-13T11:36:44.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-13T11:36:44.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-13T11:36:44.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-13T11:36:44.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-13T11:36:44.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.731 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.787 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.839 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.841 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-13T11:36:44.892 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:44.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:44.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:44.952 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:45.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:45.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:45.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:45.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-13T11:36:45.121 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-13T11:36:45.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-13T11:36:45.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-13T11:36:45.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-13T11:36:45.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-13T11:36:45.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-13T11:36:45.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-13T11:36:45.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-13T11:36:45.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-13T11:36:45.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-13T11:36:45.607 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:45.610 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-13T11:36:45.663 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-13T11:36:45.663 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-13T11:36:45.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-13T11:36:45.666 INFO:tasks.ceph.mon.a:Started 2024-06-13T11:36:45.666 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-13T11:36:45.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-13T11:36:45.706 INFO:tasks.ceph.mon.b:Started 2024-06-13T11:36:45.706 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-13T11:36:45.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-13T11:36:45.708 INFO:tasks.ceph.mon.c:Started 2024-06-13T11:36:45.708 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-13T11:36:45.708 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-13T11:36:45.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-13T11:36:45.711 INFO:tasks.ceph.mgr.y:Started 2024-06-13T11:36:45.711 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-13T11:36:45.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-13T11:36:45.713 INFO:tasks.ceph.mgr.x:Started 2024-06-13T11:36:45.713 INFO:tasks.ceph:Setting crush tunables to default 2024-06-13T11:36:45.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-06-13T11:36:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.819+0000 7f34e208c640 1 Processor -- start 2024-06-13T11:36:45.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.819+0000 7f34e208c640 1 -- start start 2024-06-13T11:36:45.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34e208c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:45.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34e208c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34e208c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34dc0d3e80 con 0x7f34dc0d3130 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34e208c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f34dc0d0d90 con 0x7f34dc0d0f90 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34e208c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f34dc0d1950 con 0x7f34dc1411c0 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35412/0 (socket says 172.21.15.43:35412) 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 learned_addr learned my addr 172.21.15.43:0/2138584919 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-13T11:36:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:45.820+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:36:46.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:46.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.021+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:36:46.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:46.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:46.422+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34db7fe640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:47.223+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T11:36:48.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 msgr2=0x7f34dc1629d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.53:3300/0 conn(0x7f34dc1411c0 0x7f34dc1629d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 -- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 msgr2=0x7f34dc0d1410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 --2- 172.21.15.43:0/2138584919 >> v2:172.21.15.43:3300/0 conn(0x7f34dc0d0f90 0x7f34dc0d1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 -- 172.21.15.43:0/2138584919 >> v1:172.21.15.53:6789/0 conn(0x7f34dc0d3130 legacy=0x7f34dc0d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 -- 172.21.15.43:0/2138584919 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34dc161ef0 con 0x7f34c80036b0 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34d97fa640 1 -- 172.21.15.43:0/2138584919 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f34dc0d0d90 con 0x7f34c80072c0 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:48.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:48.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:48.820+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:36:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.021+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:49.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.021+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:49.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.021+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:49.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.021+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:49.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.021+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:36:49.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.422+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:49.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.422+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:49.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.422+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:49.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.422+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:49.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:49.422+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T11:36:50.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.224+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.224+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-13T11:36:50.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.224+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-13T11:36:50.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.224+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:36:50.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.224+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T11:36:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.986+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560756504 0 0) 0x7f34dc161ef0 con 0x7f34c80036b0 2024-06-13T11:36:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.986+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c4003520 con 0x7f34c80036b0 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 744929154 0 0) 0x7f34c4003520 con 0x7f34c80036b0 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c8009780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c8009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c800b010 con 0x7f34c80036b0 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f34cc00d580 con 0x7f34c80036b0 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 >> v1:172.21.15.43:6789/0 conn(0x7f34c80036b0 legacy=0x7f34c8005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34dbfff640 1 -- 172.21.15.43:0/2138584919 reap_dead start 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0d0d90 con 0x7f34c4003fc0 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34c400bca0 con 0x7f34c4004d40 2024-06-13T11:36:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f34c400bea0 con 0x7f34c80072c0 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.987+0000 7f34db7fe640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.988+0000 7f34dbfff640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.988+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.988+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.988+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 msgr2=0x7f34c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.988+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.988+0000 7f34daffd640 1 -- 172.21.15.43:0/2138584919 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4003520 con 0x7f34c4003fc0 2024-06-13T11:36:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.989+0000 7f34daffd640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34c4004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34d0019b00 tx=0x7f34c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d83c80177abae6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.990+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0039070 con 0x7f34c4003fc0 2024-06-13T11:36:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.990+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d002c820 con 0x7f34c4003fc0 2024-06-13T11:36:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.990+0000 7f34da7fc640 1 -- 172.21.15.43:0/2138584919 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d000f040 con 0x7f34c4003fc0 2024-06-13T11:36:50.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 -- 172.21.15.43:0/2138584919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 msgr2=0x7f34c4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34c4004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34d0019b00 tx=0x7f34c4005830 comp rx=0 tx=0).stop 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 -- 172.21.15.43:0/2138584919 shutdown_connections 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34c4004800 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 --2- 172.21.15.43:0/2138584919 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34c40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 -- 172.21.15.43:0/2138584919 >> 172.21.15.43:0/2138584919 conn(0x7f34dc0b35d0 msgr2=0x7f34dc0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 -- 172.21.15.43:0/2138584919 shutdown_connections 2024-06-13T11:36:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.991+0000 7f34e208c640 1 -- 172.21.15.43:0/2138584919 wait complete. 2024-06-13T11:36:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.994+0000 7f34e208c640 1 Processor -- start 2024-06-13T11:36:50.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.994+0000 7f34e208c640 1 -- start start 2024-06-13T11:36:50.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34e208c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34dc1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34e208c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34dc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34e208c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34dc1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34e208c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1624b0 con 0x7f34c4003fc0 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34e208c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc0d4160 con 0x7f34c4004d40 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34e208c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f34dc1415a0 con 0x7f34c80072c0 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34dc1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34dc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34dc1f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35488/0 (socket says 172.21.15.43:35488) 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 -- 172.21.15.43:0/443199437 learned_addr learned my addr 172.21.15.43:0/443199437 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34dbfff640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34dc1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:50.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 -- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 msgr2=0x7f34dc1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34dc1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 -- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 msgr2=0x7f34dc151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34dc151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.995+0000 7f34db7fe640 1 -- 172.21.15.43:0/443199437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc1362d0 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34db7fe640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34dc1f3c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34cc016ab0 tx=0x7f34cc016f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc014ab0 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc014c70 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc017440 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc160680 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc160c40 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34cc017970 con 0x7f34c4003fc0 2024-06-13T11:36:50.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.996+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f34cc020770 con 0x7f34c4003fc0 2024-06-13T11:36:50.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:50.997+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34dc04ffb0 con 0x7f34c4003fc0 2024-06-13T11:36:50.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.000+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f34cc029440 con 0x7f34c4003fc0 2024-06-13T11:36:51.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.070+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f34dc0b8150 con 0x7f34c4003fc0 2024-06-13T11:36:51.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.071+0000 7f34c3fff640 1 -- 172.21.15.43:0/443199437 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f34cc029620 con 0x7f34c4003fc0 2024-06-13T11:36:51.071 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 msgr2=0x7f34dc1f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34dc1f3c20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34cc016ab0 tx=0x7f34cc016f70 comp rx=0 tx=0).stop 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 shutdown_connections 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f34c80072c0 0x7f34dc1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c4004d40 0x7f34dc151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 --2- 172.21.15.43:0/443199437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34c4003fc0 0x7f34dc1f3c20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 >> 172.21.15.43:0/443199437 conn(0x7f34dc0b35d0 msgr2=0x7f34dc0b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:51.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 shutdown_connections 2024-06-13T11:36:51.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:51.073+0000 7f34e208c640 1 -- 172.21.15.43:0/443199437 wait complete. 2024-06-13T11:36:51.084 INFO:tasks.ceph:check_enable_crimson: False 2024-06-13T11:36:51.084 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-13T11:36:51.084 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:51.084 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-13T11:36:51.111 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:51.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-13T11:36:51.114 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:51.115+0000 7fd491411040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:36:51.115 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:51.116+0000 7fabb471e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:36:51.140 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:51.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-13T11:36:51.205 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:36:51.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-13T11:36:51.271 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:51.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-13T11:36:51.279 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:51.280+0000 7fd491411040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:36:51.289 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:51.290+0000 7fabb471e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:36:51.297 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:51.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-13T11:36:51.336 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:51.337+0000 7fd491411040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:36:51.345 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:51.346+0000 7fabb471e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:36:51.361 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:51.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-13T11:36:51.426 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:36:51.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-13T11:36:51.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 09b1ee12-cf55-4bb3-825c-7a325fb780fb 0 2024-06-13T11:36:51.597 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:51.598+0000 7fd491411040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:36:51.598 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:51.599+0000 7fabb471e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:36:51.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.636+0000 7f597811b640 1 Processor -- start 2024-06-13T11:36:51.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.636+0000 7f597811b640 1 -- start start 2024-06-13T11:36:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f597811b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f59700b0f10 0x7f59700b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f597811b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 0x7f597006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f597811b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597015edc0 con 0x7f597015e8c0 2024-06-13T11:36:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f597811b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f59700b12f0 con 0x7f59700b0f10 2024-06-13T11:36:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f597811b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f597015f0a0 con 0x7f59700b5980 2024-06-13T11:36:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f59756b6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 0x7f597006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f59756b6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 0x7f597006c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58536/0 (socket says 172.21.15.53:58536) 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.637+0000 7f59756b6640 1 -- 172.21.15.53:0/1723672047 learned_addr learned my addr 172.21.15.53:0/1723672047 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.638+0000 7f5975eb7640 1 --2- 172.21.15.53:0/1723672047 >> v2:172.21.15.43:3300/0 conn(0x7f59700b0f10 0x7f59700b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.638+0000 7f59756b6640 1 -- 172.21.15.53:0/1723672047 >> v2:172.21.15.43:3300/0 conn(0x7f59700b0f10 msgr2=0x7f59700b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.638+0000 7f59756b6640 1 --2- 172.21.15.53:0/1723672047 >> v2:172.21.15.43:3300/0 conn(0x7f59700b0f10 0x7f59700b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.638+0000 7f59756b6640 1 -- 172.21.15.53:0/1723672047 >> v1:172.21.15.43:6789/0 conn(0x7f597015e8c0 legacy=0x7f5970161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.638+0000 7f59756b6640 1 -- 172.21.15.53:0/1723672047 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597015f380 con 0x7f59700b5980 2024-06-13T11:36:51.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.639+0000 7f59756b6640 1 --2- 172.21.15.53:0/1723672047 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 0x7f597006c760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5964009870 tx=0x7f596402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a076860f08f840b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:51.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.639+0000 7f5974eb5640 1 -- 172.21.15.53:0/1723672047 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964037070 con 0x7f59700b5980 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.639+0000 7f5974eb5640 1 -- 172.21.15.53:0/1723672047 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964032440 con 0x7f59700b5980 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.639+0000 7f5974eb5640 1 -- 172.21.15.53:0/1723672047 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964032810 con 0x7f59700b5980 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.639+0000 7f597811b640 1 -- 172.21.15.53:0/1723672047 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 msgr2=0x7f597006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.639+0000 7f597811b640 1 --2- 172.21.15.53:0/1723672047 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 0x7f597006c760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5964009870 tx=0x7f596402a1c0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.640+0000 7f597811b640 1 -- 172.21.15.53:0/1723672047 shutdown_connections 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.640+0000 7f597811b640 1 --2- 172.21.15.53:0/1723672047 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f59700b5980 0x7f597006c760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.640+0000 7f597811b640 1 --2- 172.21.15.53:0/1723672047 >> v2:172.21.15.43:3300/0 conn(0x7f59700b0f10 0x7f59700b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.640+0000 7f597811b640 1 -- 172.21.15.53:0/1723672047 >> 172.21.15.53:0/1723672047 conn(0x7f59700b3520 msgr2=0x7f59700b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.640+0000 7f597811b640 1 -- 172.21.15.53:0/1723672047 shutdown_connections 2024-06-13T11:36:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.640+0000 7f597811b640 1 -- 172.21.15.53:0/1723672047 wait complete. 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.641+0000 7f597811b640 1 Processor -- start 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.641+0000 7f597811b640 1 -- start start 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59700b0f10 0x7f5970157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59700b5980 0x7f59701f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 0x7f59700cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5970072df0 con 0x7f59700b5980 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5970072c70 con 0x7f59700b0f10 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5970072f70 con 0x7f597015e8c0 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 0x7f59700cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 0x7f59700cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58546/0 (socket says 172.21.15.53:58546) 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f5975eb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59700b0f10 0x7f5970157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 -- 172.21.15.53:0/1881097408 learned_addr learned my addr 172.21.15.53:0/1881097408 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:51.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59756b6640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59700b5980 0x7f59701f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 -- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59700b0f10 msgr2=0x7f5970157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59700b0f10 0x7f5970157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 -- 172.21.15.53:0/1881097408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59700b5980 msgr2=0x7f59701f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59700b5980 0x7f59701f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 -- 172.21.15.53:0/1881097408 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59701598c0 con 0x7f597015e8c0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f5975eb7640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59700b0f10 0x7f5970157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59766b8640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 0x7f59700cb970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f596800c680 tx=0x7f596800cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968003b70 con 0x7f597015e8c0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5968003d10 con 0x7f597015e8c0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5970156580 con 0x7f597015e8c0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.642+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968005310 con 0x7f597015e8c0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.643+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5970158de0 con 0x7f597015e8c0 2024-06-13T11:36:51.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.643+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59680054b0 con 0x7f597015e8c0 2024-06-13T11:36:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.643+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5968012880 con 0x7f597015e8c0 2024-06-13T11:36:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.643+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5970157dc0 con 0x7f597015e8c0 2024-06-13T11:36:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.646+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f59701598c0 con 0x7f597015e8c0 2024-06-13T11:36:51.647 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:51.647+0000 7fabb471e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:36:51.647 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:51.648+0000 7fd491411040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:36:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.719+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09b1ee12-cf55-4bb3-825c-7a325fb780fb", "id": 0} v 0) -- 0x7f5970161810 con 0x7f597015e8c0 2024-06-13T11:36:51.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.722+0000 7f59627fc640 1 -- 172.21.15.53:0/1881097408 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09b1ee12-cf55-4bb3-825c-7a325fb780fb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5970161810 con 0x7f597015e8c0 2024-06-13T11:36:51.721 INFO:teuthology.orchestra.run.smithi053.stdout:0 2024-06-13T11:36:51.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 msgr2=0x7f59700cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 0x7f59700cb970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f596800c680 tx=0x7f596800cb40 comp rx=0 tx=0).stop 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 shutdown_connections 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f597015e8c0 0x7f59700cb970 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59700b5980 0x7f59701f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 --2- 172.21.15.53:0/1881097408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59700b0f10 0x7f5970157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 >> 172.21.15.53:0/1881097408 conn(0x7f59700b3520 msgr2=0x7f5970161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 shutdown_connections 2024-06-13T11:36:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.723+0000 7f597811b640 1 -- 172.21.15.53:0/1881097408 wait complete. 2024-06-13T11:36:51.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 733c6e7d-76eb-480e-b221-7b16846257db 1 2024-06-13T11:36:51.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.836+0000 7f5ac6734640 1 Processor -- start 2024-06-13T11:36:51.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.836+0000 7f5ac6734640 1 -- start start 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5ac6734640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ac0070f60 0x7f5ac015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5ac6734640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ac00af080 0x7f5ac00cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5ac6734640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac00b1fa0 con 0x7f5ac015e1e0 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5ac6734640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac00b2280 con 0x7f5ac0070f60 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5ac6734640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac00ce550 con 0x7f5ac00af080 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5ac4cd1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ac00af080 0x7f5ac00cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5abffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5ac015e1e0 0x7f5ac0070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39026/0 (socket says 172.21.15.53:39026) 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5abffff640 1 -- 172.21.15.53:0/3534531157 learned_addr learned my addr 172.21.15.53:0/3534531157 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.837+0000 7f5abf7fe640 1 --2- 172.21.15.53:0/3534531157 >> v2:172.21.15.43:3300/0 conn(0x7f5ac0070f60 0x7f5ac015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.838+0000 7f5ac4cd1640 1 -- 172.21.15.53:0/3534531157 >> v2:172.21.15.43:3300/0 conn(0x7f5ac0070f60 msgr2=0x7f5ac015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.838+0000 7f5ac4cd1640 1 --2- 172.21.15.53:0/3534531157 >> v2:172.21.15.43:3300/0 conn(0x7f5ac0070f60 0x7f5ac015e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.838+0000 7f5ac4cd1640 1 -- 172.21.15.53:0/3534531157 >> v1:172.21.15.53:6789/0 conn(0x7f5ac015e1e0 legacy=0x7f5ac0070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.838+0000 7f5abeffd640 1 -- 172.21.15.53:0/3534531157 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179700817 0 0) 0x7f5ac00b1fa0 con 0x7f5ac015e1e0 2024-06-13T11:36:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.838+0000 7f5ac4cd1640 1 -- 172.21.15.53:0/3534531157 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00ce830 con 0x7f5ac00af080 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.839+0000 7f5ac4cd1640 1 --2- 172.21.15.53:0/3534531157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac00af080 0x7f5ac00cd020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00ae350 tx=0x7f5ab802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ad00bf1366af72 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.839+0000 7f5abeffd640 1 -- 172.21.15.53:0/3534531157 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8007740 con 0x7f5ac00af080 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.839+0000 7f5abeffd640 1 -- 172.21.15.53:0/3534531157 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab80078e0 con 0x7f5ac00af080 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.839+0000 7f5abeffd640 1 -- 172.21.15.53:0/3534531157 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8007cb0 con 0x7f5ac00af080 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 -- 172.21.15.53:0/3534531157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac00af080 msgr2=0x7f5ac00cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 --2- 172.21.15.53:0/3534531157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac00af080 0x7f5ac00cd020 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00ae350 tx=0x7f5ab802a680 comp rx=0 tx=0).stop 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 -- 172.21.15.53:0/3534531157 shutdown_connections 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 --2- 172.21.15.53:0/3534531157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac00af080 0x7f5ac00cd020 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 --2- 172.21.15.53:0/3534531157 >> v2:172.21.15.43:3300/0 conn(0x7f5ac0070f60 0x7f5ac015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 -- 172.21.15.53:0/3534531157 >> 172.21.15.53:0/3534531157 conn(0x7f5ac006b970 msgr2=0x7f5ac006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 -- 172.21.15.53:0/3534531157 shutdown_connections 2024-06-13T11:36:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.840+0000 7f5ac6734640 1 -- 172.21.15.53:0/3534531157 wait complete. 2024-06-13T11:36:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.841+0000 7f5ac6734640 1 Processor -- start 2024-06-13T11:36:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.841+0000 7f5ac6734640 1 -- start start 2024-06-13T11:36:51.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac6734640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 0x7f5ac006f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac6734640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00af080 0x7f5ac0160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac6734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac015e1e0 0x7f5ac0161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac6734640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00b19f0 con 0x7f5ac00af080 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac6734640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00b1870 con 0x7f5ac015e1e0 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac6734640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00b1b70 con 0x7f5ac0070f60 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 0x7f5ac006f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac4cd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac015e1e0 0x7f5ac0161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 0x7f5ac006f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58560/0 (socket says 172.21.15.53:58560) 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 -- 172.21.15.53:0/1155029155 learned_addr learned my addr 172.21.15.53:0/1155029155 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abf7fe640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00af080 0x7f5ac0160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 -- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac015e1e0 msgr2=0x7f5ac0161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac015e1e0 0x7f5ac0161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 -- 172.21.15.53:0/1155029155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00af080 msgr2=0x7f5ac0160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00af080 0x7f5ac0160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abffff640 1 -- 172.21.15.53:0/1155029155 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01f7790 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5ac4cd1640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac015e1e0 0x7f5ac0161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.842+0000 7f5abf7fe640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00af080 0x7f5ac0160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5abffff640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 0x7f5ac006f420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c430 tx=0x7f5ab000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00074e0 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab00047e0 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01f7a70 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0004bd0 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01f8030 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ab0011070 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.843+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5ab0013770 con 0x7f5ac0070f60 2024-06-13T11:36:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.844+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac004ffb0 con 0x7f5ac0070f60 2024-06-13T11:36:51.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.846+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5ab0004dc0 con 0x7f5ac0070f60 2024-06-13T11:36:51.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.919+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "733c6e7d-76eb-480e-b221-7b16846257db", "id": 1} v 0) -- 0x7f5ac0072780 con 0x7f5ac0070f60 2024-06-13T11:36:51.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.922+0000 7f5abcff9640 1 -- 172.21.15.53:0/1155029155 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "733c6e7d-76eb-480e-b221-7b16846257db", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5ab0013a90 con 0x7f5ac0070f60 2024-06-13T11:36:51.922 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-06-13T11:36:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 msgr2=0x7f5ac006f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 0x7f5ac006f420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c430 tx=0x7f5ab000c8f0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 shutdown_connections 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac015e1e0 0x7f5ac0161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ac00af080 0x7f5ac0160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 --2- 172.21.15.53:0/1155029155 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5ac0070f60 0x7f5ac006f420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 >> 172.21.15.53:0/1155029155 conn(0x7f5ac006b970 msgr2=0x7f5ac015c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.923+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 shutdown_connections 2024-06-13T11:36:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:51.924+0000 7f5ac6734640 1 -- 172.21.15.53:0/1155029155 wait complete. 2024-06-13T11:36:51.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 144432c0-51f8-41d1-b033-ec3ee63ea307 2 2024-06-13T11:36:52.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.038+0000 7f3f11b42640 1 Processor -- start 2024-06-13T11:36:52.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.038+0000 7f3f11b42640 1 -- start start 2024-06-13T11:36:52.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f11b42640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c156820 0x7f3f0c0a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f11b42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f0c070f60 0x7f3f0c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f11b42640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0c156c00 con 0x7f3f0c0a9be0 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f11b42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c0aa160 con 0x7f3f0c070f60 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f11b42640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c06e4e0 con 0x7f3f0c156820 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f0bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f0c070f60 0x7f3f0c06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f0bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f0c070f60 0x7f3f0c06efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46922/0 (socket says 172.21.15.53:46922) 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f0bfff640 1 -- 172.21.15.53:0/59608774 learned_addr learned my addr 172.21.15.53:0/59608774 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.039+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c156820 0x7f3f0c0a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0bfff640 1 -- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c156820 msgr2=0x7f3f0c0a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0bfff640 1 --2- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c156820 0x7f3f0c0a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0bfff640 1 -- 172.21.15.53:0/59608774 >> v1:172.21.15.43:6789/0 conn(0x7f3f0c0a9be0 legacy=0x7f3f0c070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0bfff640 1 -- 172.21.15.53:0/59608774 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c06e7c0 con 0x7f3f0c070f60 2024-06-13T11:36:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0b7fe640 1 --2- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c156820 0x7f3f0c0a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0bfff640 1 --2- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c06efc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009e50 tx=0x7f3f0402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=330663a984d94322 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.040+0000 7f3f0a7fc640 1 -- 172.21.15.53:0/59608774 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04036070 con 0x7f3f0c070f60 2024-06-13T11:36:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f0a7fc640 1 -- 172.21.15.53:0/59608774 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f04031600 con 0x7f3f0c070f60 2024-06-13T11:36:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f0a7fc640 1 -- 172.21.15.53:0/59608774 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f040319d0 con 0x7f3f0c070f60 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 -- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 msgr2=0x7f3f0c06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 --2- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c06efc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009e50 tx=0x7f3f0402a710 comp rx=0 tx=0).stop 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 -- 172.21.15.53:0/59608774 shutdown_connections 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 --2- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c06efc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 --2- 172.21.15.53:0/59608774 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c156820 0x7f3f0c0a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 -- 172.21.15.53:0/59608774 >> 172.21.15.53:0/59608774 conn(0x7f3f0c0d1170 msgr2=0x7f3f0c0d1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 -- 172.21.15.53:0/59608774 shutdown_connections 2024-06-13T11:36:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.041+0000 7f3f11b42640 1 -- 172.21.15.53:0/59608774 wait complete. 2024-06-13T11:36:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.042+0000 7f3f11b42640 1 Processor -- start 2024-06-13T11:36:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 -- start start 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c0a9be0 0x7f3f0c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f0c156820 0x7f3f0c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c15d6f0 con 0x7f3f0c156820 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c15d570 con 0x7f3f0c070f60 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.043+0000 7f3f11b42640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c15d8e0 con 0x7f3f0c0a9be0 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46936/0 (socket says 172.21.15.53:46936) 2024-06-13T11:36:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 -- 172.21.15.53:0/179256951 learned_addr learned my addr 172.21.15.53:0/179256951 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0affd640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c0a9be0 0x7f3f0c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0bfff640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f0c156820 0x7f3f0c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 -- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c0a9be0 msgr2=0x7f3f0c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c0a9be0 0x7f3f0c1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 -- 172.21.15.53:0/179256951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f0c156820 msgr2=0x7f3f0c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f0c156820 0x7f3f0c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 -- 172.21.15.53:0/179256951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c158240 con 0x7f3f0c070f60 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0affd640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c0a9be0 0x7f3f0c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f0b7fe640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c141a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e960 tx=0x7f3efc00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc017070 con 0x7f3f0c070f60 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc00ca00 con 0x7f3f0c070f60 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c158520 con 0x7f3f0c070f60 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00cdd0 con 0x7f3f0c070f60 2024-06-13T11:36:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.044+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c141f60 con 0x7f3f0c070f60 2024-06-13T11:36:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.045+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3efc01a070 con 0x7f3f0c070f60 2024-06-13T11:36:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.045+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3efc01c870 con 0x7f3f0c070f60 2024-06-13T11:36:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.045+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0c04ffb0 con 0x7f3f0c070f60 2024-06-13T11:36:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.049+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3efc01c450 con 0x7f3f0c070f60 2024-06-13T11:36:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.123+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "144432c0-51f8-41d1-b033-ec3ee63ea307", "id": 2} v 0) -- 0x7f3f0c068870 con 0x7f3f0c070f60 2024-06-13T11:36:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.126+0000 7f3ef3fff640 1 -- 172.21.15.53:0/179256951 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "144432c0-51f8-41d1-b033-ec3ee63ea307", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3efc01cb10 con 0x7f3f0c070f60 2024-06-13T11:36:52.125 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-06-13T11:36:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 msgr2=0x7f3f0c141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c141a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e960 tx=0x7f3efc00ee20 comp rx=0 tx=0).stop 2024-06-13T11:36:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 shutdown_connections 2024-06-13T11:36:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f0c156820 0x7f3f0c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3f0c0a9be0 0x7f3f0c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 --2- 172.21.15.53:0/179256951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c070f60 0x7f3f0c141a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 >> 172.21.15.53:0/179256951 conn(0x7f3f0c0d1170 msgr2=0x7f3f0c071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 shutdown_connections 2024-06-13T11:36:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.127+0000 7f3f11b42640 1 -- 172.21.15.53:0/179256951 wait complete. 2024-06-13T11:36:52.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 268e2348-31ca-4b7f-a7f9-3acac1381f25 3 2024-06-13T11:36:52.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.241+0000 7f1f3c1e7640 1 Processor -- start 2024-06-13T11:36:52.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.241+0000 7f1f3c1e7640 1 -- start start 2024-06-13T11:36:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f3c1e7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34147310 0x7f1f34071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f3c1e7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f341476f0 con 0x7f1f34162f10 2024-06-13T11:36:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f3c1e7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340ae320 con 0x7f1f3406f750 2024-06-13T11:36:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f3c1e7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f1f34072260 con 0x7f1f34147310 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f39f83640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34147310 0x7f1f34071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f3a784640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1f3406f750 0x7f1f340aeae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39040/0 (socket says 172.21.15.53:39040) 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f3a784640 1 -- 172.21.15.53:0/89975757 learned_addr learned my addr 172.21.15.53:0/89975757 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f38f81640 1 -- 172.21.15.53:0/89975757 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807980786 0 0) 0x7f1f340ae320 con 0x7f1f3406f750 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f39f83640 1 -- 172.21.15.53:0/89975757 >> v1:172.21.15.53:6789/0 conn(0x7f1f3406f750 legacy=0x7f1f340aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f39f83640 1 -- 172.21.15.53:0/89975757 >> v1:172.21.15.43:6789/0 conn(0x7f1f34162f10 legacy=0x7f1f3406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.242+0000 7f1f39f83640 1 -- 172.21.15.53:0/89975757 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34072540 con 0x7f1f34147310 2024-06-13T11:36:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.243+0000 7f1f39f83640 1 --2- 172.21.15.53:0/89975757 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34147310 0x7f1f34071960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f300097d0 tx=0x7f1f3002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af61a9fbac5fcbf server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.243+0000 7f1f38f81640 1 -- 172.21.15.53:0/89975757 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30037070 con 0x7f1f34147310 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.243+0000 7f1f38f81640 1 -- 172.21.15.53:0/89975757 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f30032440 con 0x7f1f34147310 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.243+0000 7f1f38f81640 1 -- 172.21.15.53:0/89975757 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30032810 con 0x7f1f34147310 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/89975757 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34147310 msgr2=0x7f1f34071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 --2- 172.21.15.53:0/89975757 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34147310 0x7f1f34071960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f300097d0 tx=0x7f1f3002a210 comp rx=0 tx=0).stop 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/89975757 shutdown_connections 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 --2- 172.21.15.53:0/89975757 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34147310 0x7f1f34071960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/89975757 >> 172.21.15.53:0/89975757 conn(0x7f1f3406b390 msgr2=0x7f1f3406b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/89975757 shutdown_connections 2024-06-13T11:36:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.244+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/89975757 wait complete. 2024-06-13T11:36:52.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.245+0000 7f1f3c1e7640 1 Processor -- start 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.245+0000 7f1f3c1e7640 1 -- start start 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3c1e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 0x7f1f34153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3c1e7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f34147310 0x7f1f34145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3c1e7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34162f10 0x7f1f341455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3c1e7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34071ea0 con 0x7f1f34147310 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3c1e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340ae5c0 con 0x7f1f3406f750 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3c1e7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f1f34072020 con 0x7f1f34162f10 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 0x7f1f34153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f3a784640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34162f10 0x7f1f341455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 0x7f1f34153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46948/0 (socket says 172.21.15.53:46948) 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 -- 172.21.15.53:0/599690203 learned_addr learned my addr 172.21.15.53:0/599690203 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39782640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f34147310 0x7f1f34145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 -- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34162f10 msgr2=0x7f1f341455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34162f10 0x7f1f341455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 -- 172.21.15.53:0/599690203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f34147310 msgr2=0x7f1f34145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f34147310 0x7f1f34145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.246+0000 7f1f39f83640 1 -- 172.21.15.53:0/599690203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34144d20 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f39f83640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 0x7f1f34153440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f300097d0 tx=0x7f1f300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30041070 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3003c890 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f34143c80 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30037040 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f34144240 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f30044070 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.247+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1f3003d3f0 con 0x7f1f3406f750 2024-06-13T11:36:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.248+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3404ffb0 con 0x7f1f3406f750 2024-06-13T11:36:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.252+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1f3003cc80 con 0x7f1f3406f750 2024-06-13T11:36:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.325+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "268e2348-31ca-4b7f-a7f9-3acac1381f25", "id": 3} v 0) -- 0x7f1f34073180 con 0x7f1f3406f750 2024-06-13T11:36:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.328+0000 7f1f2a7fc640 1 -- 172.21.15.53:0/599690203 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "268e2348-31ca-4b7f-a7f9-3acac1381f25", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1f30046450 con 0x7f1f3406f750 2024-06-13T11:36:52.327 INFO:teuthology.orchestra.run.smithi053.stdout:3 2024-06-13T11:36:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 msgr2=0x7f1f34153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 0x7f1f34153440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f300097d0 tx=0x7f1f300046c0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 shutdown_connections 2024-06-13T11:36:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1f34162f10 0x7f1f341455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f34147310 0x7f1f34145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 --2- 172.21.15.53:0/599690203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f3406f750 0x7f1f34153440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 >> 172.21.15.53:0/599690203 conn(0x7f1f3406b390 msgr2=0x7f1f340d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 shutdown_connections 2024-06-13T11:36:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.329+0000 7f1f3c1e7640 1 -- 172.21.15.53:0/599690203 wait complete. 2024-06-13T11:36:52.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new ce14b45f-0565-4254-917e-6db6c8731fac 4 2024-06-13T11:36:52.425 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.426+0000 7fabb471e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:36:52.435 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.436+0000 7fd491411040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:36:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.442+0000 7f72948ca640 1 Processor -- start 2024-06-13T11:36:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.442+0000 7f72948ca640 1 -- start start 2024-06-13T11:36:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f72948ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7290070f60 0x7f7290166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f72948ca640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729015fef0 con 0x7f7290145d80 2024-06-13T11:36:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f72948ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72901601d0 con 0x7f72901459a0 2024-06-13T11:36:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f72948ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f729015d870 con 0x7f7290070f60 2024-06-13T11:36:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f728ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7290070f60 0x7f7290166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f728e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f72901459a0 0x7f729006f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39056/0 (socket says 172.21.15.53:39056) 2024-06-13T11:36:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f728e59c640 1 -- 172.21.15.53:0/3611718738 learned_addr learned my addr 172.21.15.53:0/3611718738 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-06-13T11:36:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f728ed9d640 1 -- 172.21.15.53:0/3611718738 >> v1:172.21.15.53:6789/0 conn(0x7f72901459a0 legacy=0x7f729006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f728ed9d640 1 -- 172.21.15.53:0/3611718738 >> v1:172.21.15.43:6789/0 conn(0x7f7290145d80 legacy=0x7f7290070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.443+0000 7f728ed9d640 1 -- 172.21.15.53:0/3611718738 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72901604b0 con 0x7f7290070f60 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.444+0000 7f728ed9d640 1 --2- 172.21.15.53:0/3611718738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7290070f60 0x7f7290166fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7288009d90 tx=0x7f728802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6342427f9930256a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.444+0000 7f728d59a640 1 -- 172.21.15.53:0/3611718738 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288007740 con 0x7f7290070f60 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.444+0000 7f728d59a640 1 -- 172.21.15.53:0/3611718738 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72880078e0 con 0x7f7290070f60 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.444+0000 7f728d59a640 1 -- 172.21.15.53:0/3611718738 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288007cb0 con 0x7f7290070f60 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 -- 172.21.15.53:0/3611718738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7290070f60 msgr2=0x7f7290166fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 --2- 172.21.15.53:0/3611718738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7290070f60 0x7f7290166fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7288009d90 tx=0x7f728802a6f0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 -- 172.21.15.53:0/3611718738 shutdown_connections 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 --2- 172.21.15.53:0/3611718738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7290070f60 0x7f7290166fd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 -- 172.21.15.53:0/3611718738 >> 172.21.15.53:0/3611718738 conn(0x7f729006b970 msgr2=0x7f729006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 -- 172.21.15.53:0/3611718738 shutdown_connections 2024-06-13T11:36:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.445+0000 7f72948ca640 1 -- 172.21.15.53:0/3611718738 wait complete. 2024-06-13T11:36:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.446+0000 7f72948ca640 1 Processor -- start 2024-06-13T11:36:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.446+0000 7f72948ca640 1 -- start start 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f72948ca640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290070f60 0x7f72901f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f72948ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 0x7f7290158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f72948ca640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 0x7f72901423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f72948ca640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f729006f120 con 0x7f7290070f60 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f72948ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f729006fca0 con 0x7f72901459a0 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f72948ca640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f729006f2a0 con 0x7f7290145d80 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f728ed9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 0x7f72901423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f728dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 0x7f7290158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f728ed9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 0x7f72901423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58598/0 (socket says 172.21.15.53:58598) 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f728dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 0x7f7290158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46960/0 (socket says 172.21.15.53:46960) 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f728ed9d640 1 -- 172.21.15.53:0/1319937179 learned_addr learned my addr 172.21.15.53:0/1319937179 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.447+0000 7f728e59c640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290070f60 0x7f72901f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728ed9d640 1 -- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 msgr2=0x7f7290158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728ed9d640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 0x7f7290158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728ed9d640 1 -- 172.21.15.53:0/1319937179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290070f60 msgr2=0x7f72901f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728ed9d640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290070f60 0x7f72901f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728ed9d640 1 -- 172.21.15.53:0/1319937179 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7290159690 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728dd9b640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 0x7f7290158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f728ed9d640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 0x7f72901423f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7288009eb0 tx=0x7f7288004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288040070 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7288031c90 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7290159970 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288045680 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7290159f30 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7288039040 con 0x7f7290145d80 2024-06-13T11:36:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.448+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f728803c930 con 0x7f7290145d80 2024-06-13T11:36:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.449+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72900cda80 con 0x7f7290145d80 2024-06-13T11:36:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.451+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7288053080 con 0x7f7290145d80 2024-06-13T11:36:52.518 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.519+0000 7fabb471e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:36:52.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.525+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ce14b45f-0565-4254-917e-6db6c8731fac", "id": 4} v 0) -- 0x7f729004ffb0 con 0x7f7290145d80 2024-06-13T11:36:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.528+0000 7f727effd640 1 -- 172.21.15.53:0/1319937179 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce14b45f-0565-4254-917e-6db6c8731fac", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7288007840 con 0x7f7290145d80 2024-06-13T11:36:52.527 INFO:teuthology.orchestra.run.smithi053.stdout:4 2024-06-13T11:36:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 msgr2=0x7f72901423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 0x7f72901423f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7288009eb0 tx=0x7f7288004a40 comp rx=0 tx=0).stop 2024-06-13T11:36:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 shutdown_connections 2024-06-13T11:36:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290145d80 0x7f72901423f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901459a0 0x7f7290158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 --2- 172.21.15.53:0/1319937179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290070f60 0x7f72901f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 >> 172.21.15.53:0/1319937179 conn(0x7f729006b970 msgr2=0x7f7290144c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 shutdown_connections 2024-06-13T11:36:52.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.529+0000 7f72948ca640 1 -- 172.21.15.53:0/1319937179 wait complete. 2024-06-13T11:36:52.529 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.531+0000 7fd491411040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:36:52.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2 5 2024-06-13T11:36:52.563 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.564+0000 7fabb471e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:36:52.576 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.577+0000 7fd491411040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:36:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.642+0000 7f62aec4d640 1 Processor -- start 2024-06-13T11:36:52.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.642+0000 7f62aec4d640 1 -- start start 2024-06-13T11:36:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62aec4d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f62a80b2220 0x7f62a815f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62aec4d640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a815bed0 con 0x7f62a80b1e40 2024-06-13T11:36:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62aec4d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a815c1b0 con 0x7f62a80b0c30 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62aec4d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f62a80b04c0 con 0x7f62a80b2220 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62ad1ea640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f62a80b0c30 0x7f62a80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39060/0 (socket says 172.21.15.53:39060) 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62ad1ea640 1 -- 172.21.15.53:0/3063858086 learned_addr learned my addr 172.21.15.53:0/3063858086 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62a7fff640 1 --2- 172.21.15.53:0/3063858086 >> v2:172.21.15.53:3300/0 conn(0x7f62a80b2220 0x7f62a815f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62a77fe640 1 -- 172.21.15.53:0/3063858086 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657857190 0 0) 0x7f62a815c1b0 con 0x7f62a80b0c30 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62a77fe640 1 -- 172.21.15.53:0/3063858086 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6298005730 con 0x7f62a80b0c30 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62a7fff640 1 -- 172.21.15.53:0/3063858086 >> v1:172.21.15.53:6789/0 conn(0x7f62a80b0c30 legacy=0x7f62a80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.643+0000 7f62a7fff640 1 -- 172.21.15.53:0/3063858086 >> v1:172.21.15.43:6789/0 conn(0x7f62a80b1e40 legacy=0x7f62a815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.644+0000 7f62a7fff640 1 -- 172.21.15.53:0/3063858086 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a815c490 con 0x7f62a80b2220 2024-06-13T11:36:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.644+0000 7f62a7fff640 1 --2- 172.21.15.53:0/3063858086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815f7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62940097a0 tx=0x7f629402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4328e558d72fe091 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.644+0000 7f62a77fe640 1 -- 172.21.15.53:0/3063858086 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294037070 con 0x7f62a80b2220 2024-06-13T11:36:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.644+0000 7f62a77fe640 1 -- 172.21.15.53:0/3063858086 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6294032440 con 0x7f62a80b2220 2024-06-13T11:36:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.644+0000 7f62a77fe640 1 -- 172.21.15.53:0/3063858086 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294032810 con 0x7f62a80b2220 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 -- 172.21.15.53:0/3063858086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 msgr2=0x7f62a815f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 --2- 172.21.15.53:0/3063858086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815f7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62940097a0 tx=0x7f629402a1a0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 -- 172.21.15.53:0/3063858086 shutdown_connections 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 --2- 172.21.15.53:0/3063858086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815f7e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 -- 172.21.15.53:0/3063858086 >> 172.21.15.53:0/3063858086 conn(0x7f62a806c090 msgr2=0x7f62a80671f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 -- 172.21.15.53:0/3063858086 shutdown_connections 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.645+0000 7f62aec4d640 1 -- 172.21.15.53:0/3063858086 wait complete. 2024-06-13T11:36:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.646+0000 7f62aec4d640 1 Processor -- start 2024-06-13T11:36:52.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.646+0000 7f62aec4d640 1 -- start start 2024-06-13T11:36:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62aec4d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62a80b0c30 0x7f62a8150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62aec4d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62a80b1e40 0x7f62a815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62aec4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62aec4d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62a80b11f0 con 0x7f62a80b0c30 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62aec4d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f62a80b1070 con 0x7f62a80b2220 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62aec4d640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f62a80b1370 con 0x7f62a80b1e40 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62ad1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62a7fff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62a80b1e40 0x7f62a815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62ad1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46986/0 (socket says 172.21.15.53:46986) 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62ad1ea640 1 -- 172.21.15.53:0/2812447285 learned_addr learned my addr 172.21.15.53:0/2812447285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.647+0000 7f62ac9e9640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62a80b0c30 0x7f62a8150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a7fff640 1 -- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 msgr2=0x7f62a815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a7fff640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a7fff640 1 -- 172.21.15.53:0/2812447285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62a80b0c30 msgr2=0x7f62a8150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a7fff640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62a80b0c30 0x7f62a8150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a7fff640 1 -- 172.21.15.53:0/2812447285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a81f3750 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a7fff640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62a80b1e40 0x7f62a815b6a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6294031000 tx=0x7f62940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294041030 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6294030500 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294037040 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a81f3a30 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a81f3ff0 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6294044070 con 0x7f62a80b1e40 2024-06-13T11:36:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.648+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f629403dbd0 con 0x7f62a80b1e40 2024-06-13T11:36:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.649+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a80683e0 con 0x7f62a80b1e40 2024-06-13T11:36:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.651+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f62a80683e0 con 0x7f62a80b1e40 2024-06-13T11:36:52.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.724+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2", "id": 5} v 0) -- 0x7f62a804ffb0 con 0x7f62a80b1e40 2024-06-13T11:36:52.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.727+0000 7f62a57fa640 1 -- 172.21.15.53:0/2812447285 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f629403d650 con 0x7f62a80b1e40 2024-06-13T11:36:52.726 INFO:teuthology.orchestra.run.smithi053.stdout:5 2024-06-13T11:36:52.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62a80b1e40 msgr2=0x7f62a815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62a80b1e40 0x7f62a815b6a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6294031000 tx=0x7f62940046c0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 shutdown_connections 2024-06-13T11:36:52.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62a80b2220 0x7f62a815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f62a80b1e40 0x7f62a815b6a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 --2- 172.21.15.53:0/2812447285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62a80b0c30 0x7f62a8150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 >> 172.21.15.53:0/2812447285 conn(0x7f62a806c090 msgr2=0x7f62a814c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 shutdown_connections 2024-06-13T11:36:52.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.728+0000 7f62aec4d640 1 -- 172.21.15.53:0/2812447285 wait complete. 2024-06-13T11:36:52.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new ecb9f0e2-0780-43f0-aa5e-2a5acd412abe 6 2024-06-13T11:36:52.751 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.752+0000 7fabb471e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:36:52.756 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.756+0000 7fd491411040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:36:52.809 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.810+0000 7fabb471e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:36:52.815 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.816+0000 7fd491411040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:36:52.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.860+0000 7fe322170640 1 Processor -- start 2024-06-13T11:36:52.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.860+0000 7fe322170640 1 -- start start 2024-06-13T11:36:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe322170640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe31c15e460 0x7fe31c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe322170640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe31c0ae200 0x7fe31c0ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe322170640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c0d3630 con 0x7fe31c0d15c0 2024-06-13T11:36:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe322170640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe31c0d3910 con 0x7fe31c15e460 2024-06-13T11:36:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe322170640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe31c0d3bf0 con 0x7fe31c0ae200 2024-06-13T11:36:52.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe31c0ae200 0x7fe31c0ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe31c0ae200 0x7fe31c0ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47000/0 (socket says 172.21.15.53:47000) 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 -- 172.21.15.53:0/85300199 learned_addr learned my addr 172.21.15.53:0/85300199 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe31b7fe640 1 --2- 172.21.15.53:0/85300199 >> v2:172.21.15.43:3300/0 conn(0x7fe31c15e460 0x7fe31c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 -- 172.21.15.53:0/85300199 >> v2:172.21.15.43:3300/0 conn(0x7fe31c15e460 msgr2=0x7fe31c0aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 --2- 172.21.15.53:0/85300199 >> v2:172.21.15.43:3300/0 conn(0x7fe31c15e460 0x7fe31c0aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 -- 172.21.15.53:0/85300199 >> v1:172.21.15.43:6789/0 conn(0x7fe31c0d15c0 legacy=0x7fe31c1621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.861+0000 7fe312ffd640 1 -- 172.21.15.53:0/85300199 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c0d3ed0 con 0x7fe31c0ae200 2024-06-13T11:36:52.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.862+0000 7fe312ffd640 1 --2- 172.21.15.53:0/85300199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0ae200 0x7fe31c0ae660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe31c161d90 tx=0x7fe30402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c19c3f4deb924bfc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.862+0000 7fe31affd640 1 -- 172.21.15.53:0/85300199 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304037070 con 0x7fe31c0ae200 2024-06-13T11:36:52.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.862+0000 7fe31affd640 1 -- 172.21.15.53:0/85300199 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe304032440 con 0x7fe31c0ae200 2024-06-13T11:36:52.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.862+0000 7fe31affd640 1 -- 172.21.15.53:0/85300199 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304032810 con 0x7fe31c0ae200 2024-06-13T11:36:52.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 -- 172.21.15.53:0/85300199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0ae200 msgr2=0x7fe31c0ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 --2- 172.21.15.53:0/85300199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0ae200 0x7fe31c0ae660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe31c161d90 tx=0x7fe30402a1e0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 -- 172.21.15.53:0/85300199 shutdown_connections 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 --2- 172.21.15.53:0/85300199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0ae200 0x7fe31c0ae660 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 --2- 172.21.15.53:0/85300199 >> v2:172.21.15.43:3300/0 conn(0x7fe31c15e460 0x7fe31c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 -- 172.21.15.53:0/85300199 >> 172.21.15.53:0/85300199 conn(0x7fe31c0673d0 msgr2=0x7fe31c0d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 -- 172.21.15.53:0/85300199 shutdown_connections 2024-06-13T11:36:52.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.863+0000 7fe322170640 1 -- 172.21.15.53:0/85300199 wait complete. 2024-06-13T11:36:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.864+0000 7fe322170640 1 Processor -- start 2024-06-13T11:36:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.864+0000 7fe322170640 1 -- start start 2024-06-13T11:36:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe322170640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 0x7fe31c14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe322170640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 0x7fe31c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe322170640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe31c15e460 0x7fe31c160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe322170640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0d1a30 con 0x7fe31c15e460 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe322170640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0d32c0 con 0x7fe31c0d15c0 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe322170640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c0d1bb0 con 0x7fe31c0ae200 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 0x7fe31c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 0x7fe31c14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 0x7fe31c150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47002/0 (socket says 172.21.15.53:47002) 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 0x7fe31c14e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58604/0 (socket says 172.21.15.53:58604) 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 -- 172.21.15.53:0/1654036875 learned_addr learned my addr 172.21.15.53:0/1654036875 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe31bfff640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe31c15e460 0x7fe31c160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 -- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 msgr2=0x7fe31c14e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 0x7fe31c14e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 -- 172.21.15.53:0/1654036875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe31c15e460 msgr2=0x7fe31c160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe31c15e460 0x7fe31c160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe312ffd640 1 -- 172.21.15.53:0/1654036875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c160c50 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.865+0000 7fe31b7fe640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 0x7fe31c14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe312ffd640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 0x7fe31c150f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe30402a220 tx=0x7fe3040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304037040 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe304042070 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304030880 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c160f30 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c14f180 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe304030a20 con 0x7fe31c0d15c0 2024-06-13T11:36:52.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.866+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe304047b40 con 0x7fe31c0d15c0 2024-06-13T11:36:52.868 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.866+0000 7fabb471e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:36:52.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.867+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c04ffb0 con 0x7fe31c0d15c0 2024-06-13T11:36:52.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.869+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe304047460 con 0x7fe31c0d15c0 2024-06-13T11:36:52.873 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.874+0000 7fd491411040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:36:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.943+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ecb9f0e2-0780-43f0-aa5e-2a5acd412abe", "id": 6} v 0) -- 0x7fe31c0ab700 con 0x7fe31c0d15c0 2024-06-13T11:36:52.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.945+0000 7fe318ff9640 1 -- 172.21.15.53:0/1654036875 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecb9f0e2-0780-43f0-aa5e-2a5acd412abe", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe304047640 con 0x7fe31c0d15c0 2024-06-13T11:36:52.945 INFO:teuthology.orchestra.run.smithi053.stdout:6 2024-06-13T11:36:52.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 msgr2=0x7fe31c150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 0x7fe31c150f10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe30402a220 tx=0x7fe3040046c0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 shutdown_connections 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe31c15e460 0x7fe31c160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe31c0d15c0 0x7fe31c150f10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 --2- 172.21.15.53:0/1654036875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe31c0ae200 0x7fe31c14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 >> 172.21.15.53:0/1654036875 conn(0x7fe31c0673d0 msgr2=0x7fe31c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 shutdown_connections 2024-06-13T11:36:52.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:52.946+0000 7fe322170640 1 -- 172.21.15.53:0/1654036875 wait complete. 2024-06-13T11:36:52.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd new 3bf998af-5853-4a90-b04d-60956ca29b76 7 2024-06-13T11:36:52.983 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:52.985+0000 7fabb471e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:36:52.994 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:52.996+0000 7fd491411040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:36:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.060+0000 7f3d7d3c1640 1 Processor -- start 2024-06-13T11:36:53.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.060+0000 7f3d7d3c1640 1 -- start start 2024-06-13T11:36:53.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d7d3c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 0x7f3d780aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d7d3c1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d780ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d7d3c1640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d780d3630 con 0x7f3d780d15c0 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d7d3c1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3d780d3910 con 0x7f3d7815e460 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d7d3c1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3d780d3bf0 con 0x7f3d780ae200 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d780ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d76ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 0x7f3d780aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d780ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58618/0 (socket says 172.21.15.53:58618) 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d76ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 0x7f3d780aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47018/0 (socket says 172.21.15.53:47018) 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 -- 172.21.15.53:0/2543995074 learned_addr learned my addr 172.21.15.53:0/2543995074 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 -- 172.21.15.53:0/2543995074 >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 msgr2=0x7f3d780aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 --2- 172.21.15.53:0/2543995074 >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 0x7f3d780aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 -- 172.21.15.53:0/2543995074 >> v1:172.21.15.43:6789/0 conn(0x7f3d780d15c0 legacy=0x7f3d781621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d767fc640 1 -- 172.21.15.53:0/2543995074 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d780d3ed0 con 0x7f3d780ae200 2024-06-13T11:36:53.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.061+0000 7f3d76ffd640 1 --2- 172.21.15.53:0/2543995074 >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 0x7f3d780aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.062+0000 7f3d767fc640 1 --2- 172.21.15.53:0/2543995074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d780ae660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8172de7fb311dfae server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.062+0000 7f3d75ffb640 1 -- 172.21.15.53:0/2543995074 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c037070 con 0x7f3d780ae200 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.062+0000 7f3d75ffb640 1 -- 172.21.15.53:0/2543995074 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c032440 con 0x7f3d780ae200 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.062+0000 7f3d75ffb640 1 -- 172.21.15.53:0/2543995074 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c032810 con 0x7f3d780ae200 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2543995074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 msgr2=0x7f3d780ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2543995074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d780ae660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009870 tx=0x7f3d6c02a1c0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2543995074 shutdown_connections 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2543995074 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d780ae660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2543995074 >> v2:172.21.15.53:3300/0 conn(0x7f3d7815e460 0x7f3d780aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2543995074 >> 172.21.15.53:0/2543995074 conn(0x7f3d780673d0 msgr2=0x7f3d780d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:53.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2543995074 shutdown_connections 2024-06-13T11:36:53.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.063+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2543995074 wait complete. 2024-06-13T11:36:53.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.064+0000 7f3d7d3c1640 1 Processor -- start 2024-06-13T11:36:53.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.064+0000 7f3d7d3c1640 1 -- start start 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d7d3c1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d7814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d7d3c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d780d15c0 0x7f3d78154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d7d3c1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7815e460 0x7f3d78158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d7d3c1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d780d1a50 con 0x7f3d7815e460 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d7d3c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3d780d32c0 con 0x7f3d780d15c0 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d7d3c1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3d780d1bd0 con 0x7f3d780ae200 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d76ffd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d7814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d767fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d780d15c0 0x7f3d78154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d76ffd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d7814fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.53:58624/0 (socket says 172.21.15.53:58624) 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d76ffd640 1 -- 172.21.15.53:0/2712508384 learned_addr learned my addr 172.21.15.53:0/2712508384 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d777fe640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7815e460 0x7f3d78158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d767fc640 1 -- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 msgr2=0x7f3d7814fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d767fc640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d7814fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d767fc640 1 -- 172.21.15.53:0/2712508384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7815e460 msgr2=0x7f3d78158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d767fc640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7815e460 0x7f3d78158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.065+0000 7f3d767fc640 1 -- 172.21.15.53:0/2712508384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7815aa00 con 0x7f3d780d15c0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d767fc640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d780d15c0 0x7f3d78154600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c031000 tx=0x7f3d6c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c041020 con 0x7f3d780d15c0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c030660 con 0x7f3d780d15c0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7815ace0 con 0x7f3d780d15c0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c037040 con 0x7f3d780d15c0 2024-06-13T11:36:53.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7815b580 con 0x7f3d780d15c0 2024-06-13T11:36:53.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d6c044020 con 0x7f3d780d15c0 2024-06-13T11:36:53.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.066+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3d6c03db50 con 0x7f3d780d15c0 2024-06-13T11:36:53.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.067+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7815b0d0 con 0x7f3d780d15c0 2024-06-13T11:36:53.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.071+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3d6c04b030 con 0x7f3d780d15c0 2024-06-13T11:36:53.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.145+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bf998af-5853-4a90-b04d-60956ca29b76", "id": 7} v 0) -- 0x7f3d7804ffb0 con 0x7f3d780d15c0 2024-06-13T11:36:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.149+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2712508384 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bf998af-5853-4a90-b04d-60956ca29b76", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3d6c03ddf0 con 0x7f3d780d15c0 2024-06-13T11:36:53.148 INFO:teuthology.orchestra.run.smithi053.stdout:7 2024-06-13T11:36:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d780d15c0 msgr2=0x7f3d78154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d780d15c0 0x7f3d78154600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c031000 tx=0x7f3d6c0046c0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 shutdown_connections 2024-06-13T11:36:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7815e460 0x7f3d78158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d780d15c0 0x7f3d78154600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 --2- 172.21.15.53:0/2712508384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3d780ae200 0x7f3d7814fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 >> 172.21.15.53:0/2712508384 conn(0x7f3d780673d0 msgr2=0x7f3d780b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 shutdown_connections 2024-06-13T11:36:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:36:53.150+0000 7f3d7d3c1640 1 -- 172.21.15.53:0/2712508384 wait complete. 2024-06-13T11:36:53.159 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-13T11:36:53.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-13T11:36:53.162 INFO:tasks.ceph.osd.0:Started 2024-06-13T11:36:53.162 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-13T11:36:53.162 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-13T11:36:53.164 INFO:tasks.ceph.osd.1:Started 2024-06-13T11:36:53.164 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-13T11:36:53.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-13T11:36:53.166 INFO:tasks.ceph.osd.2:Started 2024-06-13T11:36:53.166 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-13T11:36:53.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-13T11:36:53.169 INFO:tasks.ceph.osd.3:Started 2024-06-13T11:36:53.169 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-13T11:36:53.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-13T11:36:53.202 INFO:tasks.ceph.osd.4:Started 2024-06-13T11:36:53.202 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-13T11:36:53.202 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-13T11:36:53.205 INFO:tasks.ceph.osd.5:Started 2024-06-13T11:36:53.205 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-13T11:36:53.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-13T11:36:53.207 INFO:tasks.ceph.osd.6:Started 2024-06-13T11:36:53.208 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-13T11:36:53.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-13T11:36:53.210 INFO:tasks.ceph.osd.7:Started 2024-06-13T11:36:53.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:36:53.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.334+0000 7f8fc368c640 1 Processor -- start 2024-06-13T11:36:53.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.334+0000 7f8fc368c640 1 -- start start 2024-06-13T11:36:53.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc368c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8fbc155420 0x7f8fbc0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc368c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0d31a0 0x7f8fbc0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc368c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0aa5d0 con 0x7f8fbc0ae9c0 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc368c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc155800 con 0x7f8fbc155420 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc368c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc0aa870 con 0x7f8fbc0d31a0 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8fbc155420 0x7f8fbc0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8fbc155420 0x7f8fbc0ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42484/0 (socket says 172.21.15.43:42484) 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 -- 172.21.15.43:0/548328910 learned_addr learned my addr 172.21.15.43:0/548328910 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1c29640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0d31a0 0x7f8fbc0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 -- 172.21.15.43:0/548328910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0d31a0 msgr2=0x7f8fbc0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0d31a0 0x7f8fbc0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 -- 172.21.15.43:0/548328910 >> v1:172.21.15.53:6789/0 conn(0x7f8fbc0ae9c0 legacy=0x7f8fbc0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1428640 1 -- 172.21.15.43:0/548328910 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc0aab50 con 0x7f8fbc155420 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.335+0000 7f8fc1c29640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0d31a0 0x7f8fbc0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.336+0000 7f8fc1428640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc0ae480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009870 tx=0x7f8fb802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a725c3c2a43025d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.336+0000 7f8fb3fff640 1 -- 172.21.15.43:0/548328910 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8037070 con 0x7f8fbc155420 2024-06-13T11:36:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.336+0000 7f8fb3fff640 1 -- 172.21.15.43:0/548328910 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8032440 con 0x7f8fbc155420 2024-06-13T11:36:53.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.336+0000 7f8fb3fff640 1 -- 172.21.15.43:0/548328910 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8032810 con 0x7f8fbc155420 2024-06-13T11:36:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 -- 172.21.15.43:0/548328910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 msgr2=0x7f8fbc0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc0ae480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009870 tx=0x7f8fb802a250 comp rx=0 tx=0).stop 2024-06-13T11:36:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 -- 172.21.15.43:0/548328910 shutdown_connections 2024-06-13T11:36:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0d31a0 0x7f8fbc0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 --2- 172.21.15.43:0/548328910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc0ae480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 -- 172.21.15.43:0/548328910 >> 172.21.15.43:0/548328910 conn(0x7f8fbc067640 msgr2=0x7f8fbc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 -- 172.21.15.43:0/548328910 shutdown_connections 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.337+0000 7f8fc368c640 1 -- 172.21.15.43:0/548328910 wait complete. 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.338+0000 7f8fc368c640 1 Processor -- start 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.338+0000 7f8fc368c640 1 -- start start 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc368c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 0x7f8fbc1f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc368c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fbc0d31a0 0x7f8fbc158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc368c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc368c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0ab630 con 0x7f8fbc155420 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc368c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0ab110 con 0x7f8fbc0d31a0 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc368c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc0adfb0 con 0x7f8fbc0ae9c0 2024-06-13T11:36:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1428640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 0x7f8fbc1f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1428640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 0x7f8fbc1f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:49782/0 (socket says 172.21.15.43:49782) 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc0c27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fbc0d31a0 0x7f8fbc158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc1f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42492/0 (socket says 172.21.15.43:42492) 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1428640 1 -- 172.21.15.43:0/2000112094 learned_addr learned my addr 172.21.15.43:0/2000112094 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 -- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 msgr2=0x7f8fbc1f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 0x7f8fbc1f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 -- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fbc0d31a0 msgr2=0x7f8fbc158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fbc0d31a0 0x7f8fbc158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.339+0000 7f8fc1c29640 1 -- 172.21.15.43:0/2000112094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc1f1a30 con 0x7f8fbc155420 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fc0c27640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fbc0d31a0 0x7f8fbc158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fc1428640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 0x7f8fbc1f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fc1c29640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc1f75f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4007e60 tx=0x7f8fb400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb401a070 con 0x7f8fbc155420 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb4003b90 con 0x7f8fbc155420 2024-06-13T11:36:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc15b6d0 con 0x7f8fbc155420 2024-06-13T11:36:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4004030 con 0x7f8fbc155420 2024-06-13T11:36:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fb401d070 con 0x7f8fbc155420 2024-06-13T11:36:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc15bc90 con 0x7f8fbc155420 2024-06-13T11:36:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.340+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8fb40157b0 con 0x7f8fbc155420 2024-06-13T11:36:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.341+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc04ffb0 con 0x7f8fbc155420 2024-06-13T11:36:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.343+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8fb4024020 con 0x7f8fbc155420 2024-06-13T11:36:53.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.406+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fbc0ab920 con 0x7f8fbc155420 2024-06-13T11:36:53.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.406+0000 7f8fb1ffb640 1 -- 172.21.15.43:0/2000112094 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8fb4010070 con 0x7f8fbc155420 2024-06-13T11:36:53.405 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:36:53.406 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:36:53.147413+0000","last_up_change":"0.000000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 msgr2=0x7f8fbc1f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc1f75f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4007e60 tx=0x7f8fb400d4a0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 shutdown_connections 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fbc155420 0x7f8fbc1f75f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fbc0d31a0 0x7f8fbc158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 --2- 172.21.15.43:0/2000112094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fbc0ae9c0 0x7f8fbc1f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 >> 172.21.15.43:0/2000112094 conn(0x7f8fbc067640 msgr2=0x7f8fbc161ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 shutdown_connections 2024-06-13T11:36:53.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:36:53.407+0000 7f8fc368c640 1 -- 172.21.15.43:0/2000112094 wait complete. 2024-06-13T11:36:53.418 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-13T11:36:53.418 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-13T11:36:53.419 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:53.420+0000 7fd491411040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:36:53.422 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:53.423+0000 7fabb471e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:36:53.692 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:53.693+0000 7fd491411040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:36:53.696 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:53.697+0000 7fabb471e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:36:53.747 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:53.748+0000 7fd491411040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:36:53.751 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:53.753+0000 7fabb471e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:36:53.776 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T11:36:53.778+0000 7f37cbf3b640 -1 Falling back to public interface 2024-06-13T11:36:53.779 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T11:36:53.780+0000 7fcd54fc4640 -1 Falling back to public interface 2024-06-13T11:36:53.782 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T11:36:53.783+0000 7f152a416640 -1 Falling back to public interface 2024-06-13T11:36:53.789 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T11:36:53.789+0000 7fdaed016640 -1 Falling back to public interface 2024-06-13T11:36:53.814 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T11:36:53.815+0000 7ff89f01e640 -1 Falling back to public interface 2024-06-13T11:36:53.814 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T11:36:53.815+0000 7f4aa760d640 -1 Falling back to public interface 2024-06-13T11:36:53.824 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T11:36:53.825+0000 7f03dcbbe640 -1 Falling back to public interface 2024-06-13T11:36:53.829 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T11:36:53.830+0000 7f8ffb820640 -1 Falling back to public interface 2024-06-13T11:36:53.873 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:53.874+0000 7fd491411040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:36:53.879 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:53.880+0000 7fabb471e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:36:54.181 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.182+0000 7fd491411040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:36:54.190 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.191+0000 7fabb471e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:36:54.224 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-13T11:36:54.231 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.232+0000 7fd491411040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:36:54.241 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.242+0000 7fabb471e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:36:54.319 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.320+0000 7f5c8c9b6640 1 Processor -- start 2024-06-13T11:36:54.319 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.320+0000 7f5c8c9b6640 1 -- start start 2024-06-13T11:36:54.320 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8c9b6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c8815e240 0x7f5c880cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8c9b6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5c880cff20 0x7f5c880d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8c9b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c880d0f80 0x7f5c880b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8c9b6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5c880d13d0 con 0x7f5c880cff20 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8c9b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5c880d2c60 con 0x7f5c880d0f80 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8c9b6640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5c880d30f0 con 0x7f5c8815e240 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5c880cff20 0x7f5c880d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5c880cff20 0x7f5c880d0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42508/0 (socket says 172.21.15.43:42508) 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 -- 172.21.15.43:0/2628937844 learned_addr learned my addr 172.21.15.43:0/2628937844 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c86d9d640 1 --2- 172.21.15.43:0/2628937844 >> v2:172.21.15.53:3300/0 conn(0x7f5c880d0f80 0x7f5c880b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c8659c640 1 --2- 172.21.15.43:0/2628937844 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c8815e240 0x7f5c880cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 -- 172.21.15.43:0/2628937844 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c8815e240 msgr2=0x7f5c880cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 --2- 172.21.15.43:0/2628937844 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c8815e240 0x7f5c880cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 -- 172.21.15.43:0/2628937844 >> v2:172.21.15.53:3300/0 conn(0x7f5c880d0f80 msgr2=0x7f5c880b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:36:54.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 --2- 172.21.15.43:0/2628937844 >> v2:172.21.15.53:3300/0 conn(0x7f5c880d0f80 0x7f5c880b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.321+0000 7f5c85d9b640 1 -- 172.21.15.43:0/2628937844 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c880d2050 con 0x7f5c880cff20 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.322+0000 7f5c85d9b640 1 --2- 172.21.15.43:0/2628937844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880cff20 0x7f5c880d0a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c88162f40 tx=0x7f5c7c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4003e00a811a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.322+0000 7f5c8559a640 1 -- 172.21.15.43:0/2628937844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c037070 con 0x7f5c880cff20 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.322+0000 7f5c8559a640 1 -- 172.21.15.43:0/2628937844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7c032440 con 0x7f5c880cff20 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.322+0000 7f5c8559a640 1 -- 172.21.15.43:0/2628937844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c032810 con 0x7f5c880cff20 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2628937844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880cff20 msgr2=0x7f5c880d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2628937844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880cff20 0x7f5c880d0a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c88162f40 tx=0x7f5c7c02a140 comp rx=0 tx=0).stop 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2628937844 shutdown_connections 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2628937844 >> v2:172.21.15.53:3300/0 conn(0x7f5c880d0f80 0x7f5c880b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2628937844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880cff20 0x7f5c880d0a40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2628937844 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c8815e240 0x7f5c880cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2628937844 >> 172.21.15.43:0/2628937844 conn(0x7f5c8809d450 msgr2=0x7f5c880d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:54.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2628937844 shutdown_connections 2024-06-13T11:36:54.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.323+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2628937844 wait complete. 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.324+0000 7f5c8c9b6640 1 Processor -- start 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 -- start start 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c880cff20 0x7f5c881e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 0x7f5c880b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c8815e240 0x7f5c881e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5c880d28f0 con 0x7f5c880d0f80 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5c880d2610 con 0x7f5c8815e240 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8c9b6640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5c880d1c90 con 0x7f5c880cff20 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c85d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 0x7f5c880b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c85d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 0x7f5c880b8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42524/0 (socket says 172.21.15.43:42524) 2024-06-13T11:36:54.326 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c85d9b640 1 -- 172.21.15.43:0/2914347364 learned_addr learned my addr 172.21.15.43:0/2914347364 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c8659c640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c880cff20 0x7f5c881e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.325+0000 7f5c86d9d640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c8815e240 0x7f5c881e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8659c640 1 -- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c8815e240 msgr2=0x7f5c881e9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8659c640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c8815e240 0x7f5c881e9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8659c640 1 -- 172.21.15.43:0/2914347364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 msgr2=0x7f5c880b8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8659c640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 0x7f5c880b8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8659c640 1 -- 172.21.15.43:0/2914347364 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c881e9dc0 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c85d9b640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 0x7f5c880b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8659c640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c880cff20 0x7f5c881e8a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800e870 tx=0x7f5c7800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78017070 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7800ee60 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c881e7ca0 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800cb60 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c881e8260 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c7801a070 con 0x7f5c880cff20 2024-06-13T11:36:54.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.326+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5c7800cd00 con 0x7f5c880cff20 2024-06-13T11:36:54.328 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.327+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c88068d10 con 0x7f5c880cff20 2024-06-13T11:36:54.328 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.329+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5c78013470 con 0x7f5c880cff20 2024-06-13T11:36:54.391 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.392+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c880d0d40 con 0x7f5c880cff20 2024-06-13T11:36:54.391 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.392+0000 7f5c76ffd640 1 -- 172.21.15.43:0/2914347364 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5c78013650 con 0x7f5c880cff20 2024-06-13T11:36:54.392 INFO:teuthology.misc.health.smithi043.stdout: 2024-06-13T11:36:54.392 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:36:53.147413+0000","last_up_change":"0.000000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c880cff20 msgr2=0x7f5c881e8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c880cff20 0x7f5c881e8a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800e870 tx=0x7f5c7800ed30 comp rx=0 tx=0).stop 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 shutdown_connections 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c8815e240 0x7f5c881e9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c880d0f80 0x7f5c880b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 --2- 172.21.15.43:0/2914347364 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c880cff20 0x7f5c881e8a60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.393+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 >> 172.21.15.43:0/2914347364 conn(0x7f5c8809d450 msgr2=0x7f5c880ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.394+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 shutdown_connections 2024-06-13T11:36:54.393 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:36:54.394+0000 7f5c8c9b6640 1 -- 172.21.15.43:0/2914347364 wait complete. 2024-06-13T11:36:54.396 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.397+0000 7fd491411040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:36:54.402 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-13T11:36:54.412 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.413+0000 7fabb471e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:36:54.541 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.542+0000 7fd491411040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:36:54.558 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.559+0000 7fabb471e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:36:54.593 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.594+0000 7fd491411040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:36:54.612 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.613+0000 7fabb471e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:36:54.666 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.668+0000 7fd491411040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:36:54.686 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.687+0000 7fabb471e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:36:54.714 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:54.715+0000 7fd491411040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:36:54.734 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:54.735+0000 7fabb471e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:36:55.216 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:55.217+0000 7fd491411040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:36:55.238 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:55.239+0000 7fabb471e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:36:55.337 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:55.338+0000 7fd491411040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:36:55.361 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-06-13T11:36:55.362+0000 7fabb471e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:36:56.353 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:56.354+0000 7fd431ba1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-13T11:36:56.353 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T11:36:56.354+0000 7fd431ba1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-13T11:36:57.249 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T11:36:57.250+0000 7fdaed016640 -1 osd.3 0 log_to_monitors true 2024-06-13T11:36:57.273 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T11:36:57.274+0000 7f4aa760d640 -1 osd.6 0 log_to_monitors true 2024-06-13T11:36:57.305 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T11:36:57.306+0000 7fcd54fc4640 -1 osd.1 0 log_to_monitors true 2024-06-13T11:36:57.306 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T11:36:57.307+0000 7f152a416640 -1 osd.0 0 log_to_monitors true 2024-06-13T11:36:57.316 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T11:36:57.317+0000 7f37cbf3b640 -1 osd.2 0 log_to_monitors true 2024-06-13T11:36:57.344 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T11:36:57.345+0000 7ff89f01e640 -1 osd.7 0 log_to_monitors true 2024-06-13T11:36:57.354 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T11:36:57.356+0000 7f8ffb820640 -1 osd.4 0 log_to_monitors true 2024-06-13T11:36:57.361 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T11:36:57.362+0000 7f03dcbbe640 -1 osd.5 0 log_to_monitors true 2024-06-13T11:36:58.952 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T11:36:58.953+0000 7f4aa3707640 -1 osd.6 0 waiting for initial osdmap 2024-06-13T11:36:58.967 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T11:36:58.968+0000 7f4a9ad13640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:36:59.753 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T11:36:59.754+0000 7fcd50f5a640 -1 osd.1 0 waiting for initial osdmap 2024-06-13T11:36:59.772 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T11:36:59.772+0000 7fcd48d7a640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:36:59.808 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T11:36:59.809+0000 7f1525e59640 -1 osd.0 0 waiting for initial osdmap 2024-06-13T11:36:59.824 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T11:36:59.825+0000 7f151dc79640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:36:59.830 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T11:36:59.831+0000 7f37c7ed1640 -1 osd.2 0 waiting for initial osdmap 2024-06-13T11:36:59.841 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T11:36:59.842+0000 7f37bfcf1640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:36:59.863 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T11:36:59.864+0000 7fdae923e640 -1 osd.3 0 waiting for initial osdmap 2024-06-13T11:36:59.873 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T11:36:59.874+0000 7fdae084a640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:37:00.523 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T11:37:00.524+0000 7f03d8b54640 -1 osd.5 0 waiting for initial osdmap 2024-06-13T11:37:00.535 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T11:37:00.537+0000 7ff89a90c640 -1 osd.7 0 waiting for initial osdmap 2024-06-13T11:37:00.537 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T11:37:00.539+0000 7f8ff7117640 -1 osd.4 0 waiting for initial osdmap 2024-06-13T11:37:00.539 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T11:37:00.540+0000 7f03d0974640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:37:00.552 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T11:37:00.554+0000 7ff89273d640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:37:00.558 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T11:37:00.559+0000 7f8feef37640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:37:01.208 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:01.314 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.314+0000 7f4357a58640 1 Processor -- start 2024-06-13T11:37:01.314 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.315+0000 7f4357a58640 1 -- start start 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4357a58640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43500d0bc0 0x7f43500d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4357a58640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d2cb0 0x7f435015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4357a58640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43500d1ef0 con 0x7f43500d0fa0 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4357a58640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f435015fa20 con 0x7f43500d0bc0 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4357a58640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f43500d5170 con 0x7f43500d2cb0 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f43557f4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43500d0bc0 0x7f43500d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4355ff5640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f43500d0fa0 0x7f43500ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36956/0 (socket says 172.21.15.43:36956) 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f43557f4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43500d0bc0 0x7f43500d4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42574/0 (socket says 172.21.15.43:42574) 2024-06-13T11:37:01.316 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4355ff5640 1 -- 172.21.15.43:0/1304073156 learned_addr learned my addr 172.21.15.43:0/1304073156 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4354ff3640 1 --2- 172.21.15.43:0/1304073156 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d2cb0 0x7f435015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4347fff640 1 -- 172.21.15.43:0/1304073156 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382141654 0 0) 0x7f43500d1ef0 con 0x7f43500d0fa0 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f4347fff640 1 -- 172.21.15.43:0/1304073156 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f433c003520 con 0x7f43500d0fa0 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f43557f4640 1 -- 172.21.15.43:0/1304073156 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d2cb0 msgr2=0x7f435015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f43557f4640 1 --2- 172.21.15.43:0/1304073156 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d2cb0 0x7f435015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f43557f4640 1 -- 172.21.15.43:0/1304073156 >> v1:172.21.15.43:6789/0 conn(0x7f43500d0fa0 legacy=0x7f43500ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.316+0000 7f43557f4640 1 -- 172.21.15.43:0/1304073156 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43500d21d0 con 0x7f43500d0bc0 2024-06-13T11:37:01.317 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.317+0000 7f43557f4640 1 --2- 172.21.15.43:0/1304073156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d0bc0 0x7f43500d4b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4114449630f5b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:01.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.317+0000 7f4347fff640 1 -- 172.21.15.43:0/1304073156 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c037070 con 0x7f43500d0bc0 2024-06-13T11:37:01.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.317+0000 7f4347fff640 1 -- 172.21.15.43:0/1304073156 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c02adb0 con 0x7f43500d0bc0 2024-06-13T11:37:01.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.317+0000 7f4347fff640 1 -- 172.21.15.43:0/1304073156 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c032660 con 0x7f43500d0bc0 2024-06-13T11:37:01.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 -- 172.21.15.43:0/1304073156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d0bc0 msgr2=0x7f43500d4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 --2- 172.21.15.43:0/1304073156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d0bc0 0x7f43500d4b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02a060 comp rx=0 tx=0).stop 2024-06-13T11:37:01.321 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 -- 172.21.15.43:0/1304073156 shutdown_connections 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 --2- 172.21.15.43:0/1304073156 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d2cb0 0x7f435015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 --2- 172.21.15.43:0/1304073156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d0bc0 0x7f43500d4b20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 -- 172.21.15.43:0/1304073156 >> 172.21.15.43:0/1304073156 conn(0x7f435009d480 msgr2=0x7f43500d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 -- 172.21.15.43:0/1304073156 shutdown_connections 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.318+0000 7f4357a58640 1 -- 172.21.15.43:0/1304073156 wait complete. 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.319+0000 7f4357a58640 1 Processor -- start 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.319+0000 7f4357a58640 1 -- start start 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4357a58640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d0bc0 0x7f43500b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.322 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4357a58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43500d0fa0 0x7f43501ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4357a58640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 0x7f435015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4357a58640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43500d3110 con 0x7f43500d2cb0 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4357a58640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43500d2790 con 0x7f43500d0fa0 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4357a58640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f435015e830 con 0x7f43500d0bc0 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 0x7f435015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 0x7f435015d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42584/0 (socket says 172.21.15.43:42584) 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 -- 172.21.15.43:0/2968691369 learned_addr learned my addr 172.21.15.43:0/2968691369 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f43557f4640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d0bc0 0x7f43500b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4354ff3640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43500d0fa0 0x7f43501ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 -- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d0bc0 msgr2=0x7f43500b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d0bc0 0x7f43500b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.323 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 -- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43500d0fa0 msgr2=0x7f43501ea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43500d0fa0 0x7f43501ea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f4355ff5640 1 -- 172.21.15.43:0/2968691369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43500b86e0 con 0x7f43500d2cb0 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.320+0000 7f43557f4640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d0bc0 0x7f43500b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.321+0000 7f4355ff5640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 0x7f435015d380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f434800caa0 tx=0x7f434800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.321+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348017070 con 0x7f43500d2cb0 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.321+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434800ac00 con 0x7f43500d2cb0 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.321+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43500b8120 con 0x7f43500d2cb0 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.321+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348012400 con 0x7f43500d2cb0 2024-06-13T11:37:01.324 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.321+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43500cc180 con 0x7f43500d2cb0 2024-06-13T11:37:01.325 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.322+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4350068d10 con 0x7f43500d2cb0 2024-06-13T11:37:01.325 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.323+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f434801a070 con 0x7f43500d2cb0 2024-06-13T11:37:01.325 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.323+0000 7f4345ffb640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f433406bdd0 0x7f433406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.325 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.323+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f434808a4b0 con 0x7f43500d2cb0 2024-06-13T11:37:01.325 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.323+0000 7f43557f4640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f433406bdd0 0x7f433406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.325 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.324+0000 7f43557f4640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f433406bdd0 0x7f433406e290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f434c034000 tx=0x7f434c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:01.327 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.328+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4348058dc0 con 0x7f43500d2cb0 2024-06-13T11:37:01.514 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.515+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43500d4900 con 0x7f43500d2cb0 2024-06-13T11:37:01.515 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.516+0000 7f4345ffb640 1 -- 172.21.15.43:0/2968691369 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10872 (secure 0 0 0) 0x7f434805d0c0 con 0x7f43500d2cb0 2024-06-13T11:37:01.515 INFO:teuthology.misc.health.smithi043.stdout: 2024-06-13T11:37:01.515 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":14,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:00.758910+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f433406bdd0 msgr2=0x7f433406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f433406bdd0 0x7f433406e290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f434c034000 tx=0x7f434c02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 msgr2=0x7f435015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 0x7f435015d380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f434800caa0 tx=0x7f434800cf60 comp rx=0 tx=0).stop 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 shutdown_connections 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f433406bdd0 0x7f433406e290 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.518 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43500d2cb0 0x7f435015d380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.519 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43500d0fa0 0x7f43501ea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.519 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 --2- 172.21.15.43:0/2968691369 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43500d0bc0 0x7f43500b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.519 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 >> 172.21.15.43:0/2968691369 conn(0x7f435009d480 msgr2=0x7f43500b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:01.519 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 shutdown_connections 2024-06-13T11:37:01.519 INFO:teuthology.misc.health.smithi043.stderr:2024-06-13T11:37:01.518+0000 7f4357a58640 1 -- 172.21.15.43:0/2968691369 wait complete. 2024-06-13T11:37:01.527 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-13T11:37:01.527 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-13T11:37:01.528 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-13T11:37:01.528 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-13T11:37:01.530 INFO:tasks.ceph.mds.a:Started 2024-06-13T11:37:01.530 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-13T11:37:01.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-13T11:37:01.533 INFO:tasks.ceph.mds.c:Started 2024-06-13T11:37:01.533 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-13T11:37:01.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-13T11:37:01.536 INFO:tasks.ceph.mds.b:Started 2024-06-13T11:37:01.536 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-13T11:37:01.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-13T11:37:01.539 INFO:tasks.ceph.mds.d:Started 2024-06-13T11:37:01.539 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-06-13T11:37:01.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:01.609 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-06-13T11:37:01.609 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2024-06-13T11:37:01.627 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2024-06-13T11:37:01.629 INFO:tasks.ceph.mds.d.smithi053.stdout:starting mds.d at 2024-06-13T11:37:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.647+0000 7fe664bee640 1 Processor -- start 2024-06-13T11:37:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.647+0000 7fe664bee640 1 -- start start 2024-06-13T11:37:01.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe664bee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe660155420 0x7fe6600ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe664bee640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6600aa5d0 con 0x7fe6600ae9c0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe65dd9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe6600ae9c0 0x7fe6600d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36992/0 (socket says 172.21.15.43:36992) 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe65dd9b640 1 -- 172.21.15.43:0/2810311095 learned_addr learned my addr 172.21.15.43:0/2810311095 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe660155800 con 0x7fe6600d31a0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe6600aa870 con 0x7fe660155420 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe65e59c640 1 --2- 172.21.15.43:0/2810311095 >> v2:172.21.15.53:3300/0 conn(0x7fe660155420 0x7fe6600ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852254973 0 0) 0x7fe6600aa5d0 con 0x7fe6600ae9c0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe648003520 con 0x7fe6600ae9c0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.648+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519343048 0 0) 0x7fe660155800 con 0x7fe6600d31a0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.649+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6600aa5d0 con 0x7fe6600d31a0 2024-06-13T11:37:01.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.649+0000 7fe65e59c640 1 -- 172.21.15.43:0/2810311095 >> v1:172.21.15.53:6789/0 conn(0x7fe6600d31a0 legacy=0x7fe6600abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.649+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 <== mon.1 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109842296 0 0) 0x7fe6600aa5d0 con 0x7fe6600d31a0 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.649+0000 7fe65e59c640 1 -- 172.21.15.43:0/2810311095 >> v1:172.21.15.43:6789/0 conn(0x7fe6600ae9c0 legacy=0x7fe6600d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.649+0000 7fe65e59c640 1 -- 172.21.15.43:0/2810311095 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6600aab50 con 0x7fe660155420 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.649+0000 7fe65e59c640 1 --2- 172.21.15.43:0/2810311095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe660155420 0x7fe6600ae480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe66015e940 tx=0x7fe65002a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f97b1ee41f80b0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650037070 con 0x7fe660155420 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65002ac50 con 0x7fe660155420 2024-06-13T11:37:01.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe65d59a640 1 -- 172.21.15.43:0/2810311095 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6580019f0 con 0x7fe660155420 2024-06-13T11:37:01.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe660155420 msgr2=0x7fe6600ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 --2- 172.21.15.43:0/2810311095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe660155420 0x7fe6600ae480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe66015e940 tx=0x7fe65002a140 comp rx=0 tx=0).stop 2024-06-13T11:37:01.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 shutdown_connections 2024-06-13T11:37:01.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 --2- 172.21.15.43:0/2810311095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe660155420 0x7fe6600ae480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 >> 172.21.15.43:0/2810311095 conn(0x7fe660067640 msgr2=0x7fe6600d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:01.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 shutdown_connections 2024-06-13T11:37:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.650+0000 7fe664bee640 1 -- 172.21.15.43:0/2810311095 wait complete. 2024-06-13T11:37:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 Processor -- start 2024-06-13T11:37:01.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 -- start start 2024-06-13T11:37:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 0x7fe660159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6600d31a0 0x7fe66014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 0x7fe660159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6600ab630 con 0x7fe660155420 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe6600ab110 con 0x7fe6600d31a0 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.652+0000 7fe664bee640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe6600adfb0 con 0x7fe6600ae9c0 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 0x7fe660159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 0x7fe660159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6600d31a0 0x7fe66014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 0x7fe660159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:49906/0 (socket says 172.21.15.43:49906) 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6600d31a0 0x7fe66014aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:47252/0 (socket says 172.21.15.43:47252) 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 -- 172.21.15.43:0/202063378 learned_addr learned my addr 172.21.15.43:0/202063378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 0x7fe660159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42626/0 (socket says 172.21.15.43:42626) 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 -- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6600d31a0 msgr2=0x7fe66014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6600d31a0 0x7fe66014aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 -- 172.21.15.43:0/202063378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 msgr2=0x7fe660159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 0x7fe660159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 -- 172.21.15.43:0/202063378 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe660159e50 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65ed9d640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 0x7fe660159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe65e59c640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 0x7fe660159260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe650009810 tx=0x7fe6500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650041070 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65003c460 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6601f3f60 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.653+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650037040 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.654+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6601f4520 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.654+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66004ffb0 con 0x7fe6600ae9c0 2024-06-13T11:37:01.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.655+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fe650044070 con 0x7fe6600ae9c0 2024-06-13T11:37:01.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.655+0000 7fe64effd640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe64006bda0 0x7fe64006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:01.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.655+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7fe6500aad50 con 0x7fe6600ae9c0 2024-06-13T11:37:01.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.655+0000 7fe65dd9b640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe64006bda0 0x7fe64006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:01.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.656+0000 7fe65dd9b640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe64006bda0 0x7fe64006e260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe660154260 tx=0x7fe654007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:01.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.660+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe660159e50 con 0x7fe6600ae9c0 2024-06-13T11:37:01.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.883+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6600ab920 con 0x7fe6600ae9c0 2024-06-13T11:37:01.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.883+0000 7fe64effd640 1 -- 172.21.15.43:0/202063378 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fe650079660 con 0x7fe6600ae9c0 2024-06-13T11:37:01.883 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:01.883 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-13T11:37:01.883 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe64006bda0 msgr2=0x7fe64006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe64006bda0 0x7fe64006e260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe660154260 tx=0x7fe654007d30 comp rx=0 tx=0).stop 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 msgr2=0x7fe660159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 0x7fe660159260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe650009810 tx=0x7fe6500046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 shutdown_connections 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe64006bda0 0x7fe64006e260 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe660155420 0x7fe660159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6600d31a0 0x7fe66014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 --2- 172.21.15.43:0/202063378 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe6600ae9c0 0x7fe660159260 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 >> 172.21.15.43:0/202063378 conn(0x7fe660067640 msgr2=0x7fe660071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:01.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 shutdown_connections 2024-06-13T11:37:01.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:01.885+0000 7fe664bee640 1 -- 172.21.15.43:0/202063378 wait complete. 2024-06-13T11:37:03.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:04.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.002+0000 7fe3ac963640 1 Processor -- start 2024-06-13T11:37:04.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.003+0000 7fe3ac963640 1 -- start start 2024-06-13T11:37:04.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3ac963640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3a8072ae0 0x7fe3a80aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3ac963640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3a81602f0 0x7fe3a80d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3ac963640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80b0610 con 0x7fe3a80b16b0 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3ac963640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a80b1220 con 0x7fe3a81602f0 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3ac963640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a80b08f0 con 0x7fe3a8072ae0 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3a81602f0 0x7fe3a80d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3a81602f0 0x7fe3a80d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34222/0 (socket says 172.21.15.43:34222) 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 -- 172.21.15.43:0/3831683273 learned_addr learned my addr 172.21.15.43:0/3831683273 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a659c640 1 --2- 172.21.15.43:0/3831683273 >> v2:172.21.15.53:3300/0 conn(0x7fe3a8072ae0 0x7fe3a80aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 -- 172.21.15.43:0/3831683273 >> v2:172.21.15.53:3300/0 conn(0x7fe3a8072ae0 msgr2=0x7fe3a80aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 --2- 172.21.15.43:0/3831683273 >> v2:172.21.15.53:3300/0 conn(0x7fe3a8072ae0 0x7fe3a80aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 -- 172.21.15.43:0/3831683273 >> v1:172.21.15.53:6789/0 conn(0x7fe3a80b16b0 legacy=0x7fe3a815fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.004+0000 7fe3a6d9d640 1 -- 172.21.15.43:0/3831683273 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80b0bd0 con 0x7fe3a81602f0 2024-06-13T11:37:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.005+0000 7fe3a6d9d640 1 --2- 172.21.15.43:0/3831683273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a81602f0 0x7fe3a80d0230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8067890 tx=0x7fe39802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140f1ea9090fae14 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.005+0000 7fe3a559a640 1 -- 172.21.15.43:0/3831683273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398037070 con 0x7fe3a81602f0 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.005+0000 7fe3a559a640 1 -- 172.21.15.43:0/3831683273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe398032440 con 0x7fe3a81602f0 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.005+0000 7fe3a559a640 1 -- 172.21.15.43:0/3831683273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398032810 con 0x7fe3a81602f0 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.005+0000 7fe3ac963640 1 -- 172.21.15.43:0/3831683273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a81602f0 msgr2=0x7fe3a80d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.005+0000 7fe3ac963640 1 --2- 172.21.15.43:0/3831683273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a81602f0 0x7fe3a80d0230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8067890 tx=0x7fe39802a270 comp rx=0 tx=0).stop 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.006+0000 7fe3ac963640 1 -- 172.21.15.43:0/3831683273 shutdown_connections 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.006+0000 7fe3ac963640 1 --2- 172.21.15.43:0/3831683273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a81602f0 0x7fe3a80d0230 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.006+0000 7fe3ac963640 1 --2- 172.21.15.43:0/3831683273 >> v2:172.21.15.53:3300/0 conn(0x7fe3a8072ae0 0x7fe3a80aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.006+0000 7fe3ac963640 1 -- 172.21.15.43:0/3831683273 >> 172.21.15.43:0/3831683273 conn(0x7fe3a80b21f0 msgr2=0x7fe3a80b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.006+0000 7fe3ac963640 1 -- 172.21.15.43:0/3831683273 shutdown_connections 2024-06-13T11:37:04.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.006+0000 7fe3ac963640 1 -- 172.21.15.43:0/3831683273 wait complete. 2024-06-13T11:37:04.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.007+0000 7fe3ac963640 1 Processor -- start 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.007+0000 7fe3ac963640 1 -- start start 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3ac963640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 0x7fe3a815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3ac963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3a80b16b0 0x7fe3a814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3ac963640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3a81602f0 0x7fe3a8143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3ac963640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8071330 con 0x7fe3a8072ae0 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3ac963640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80711b0 con 0x7fe3a80b16b0 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3ac963640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a80714b0 con 0x7fe3a81602f0 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 0x7fe3a815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 0x7fe3a815b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34228/0 (socket says 172.21.15.43:34228) 2024-06-13T11:37:04.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 -- 172.21.15.43:0/2998589180 learned_addr learned my addr 172.21.15.43:0/2998589180 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a6d9d640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3a81602f0 0x7fe3a8143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a5d9b640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3a80b16b0 0x7fe3a814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 -- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3a81602f0 msgr2=0x7fe3a8143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3a81602f0 0x7fe3a8143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 -- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3a80b16b0 msgr2=0x7fe3a814fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3a80b16b0 0x7fe3a814fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 -- 172.21.15.43:0/2998589180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a8150db0 con 0x7fe3a8072ae0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe3a659c640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 0x7fe3a815b330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000efc0 tx=0x7fe3a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.008+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0018020 con 0x7fe3a8072ae0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.009+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a0014480 con 0x7fe3a8072ae0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.009+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a8151090 con 0x7fe3a8072ae0 2024-06-13T11:37:04.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.009+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0014850 con 0x7fe3a8072ae0 2024-06-13T11:37:04.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.009+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a806e960 con 0x7fe3a8072ae0 2024-06-13T11:37:04.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.010+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a804ffb0 con 0x7fe3a8072ae0 2024-06-13T11:37:04.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.010+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3a0005d10 con 0x7fe3a8072ae0 2024-06-13T11:37:04.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.011+0000 7fe39effd640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe38806be30 0x7fe38806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.011+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe3a008b530 con 0x7fe3a8072ae0 2024-06-13T11:37:04.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.011+0000 7fe3a5d9b640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe38806be30 0x7fe38806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.011+0000 7fe3a5d9b640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe38806be30 0x7fe38806e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3a815eb90 tx=0x7fe390009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.015+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe3a0022070 con 0x7fe3a8072ae0 2024-06-13T11:37:04.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.236+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3a80ce5c0 con 0x7fe3a8072ae0 2024-06-13T11:37:04.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.305+0000 7fe39effd640 1 -- 172.21.15.43:0/2998589180 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7fe3a0010040 con 0x7fe3a8072ae0 2024-06-13T11:37:04.323 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:04.323 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe38806be30 msgr2=0x7fe38806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe38806be30 0x7fe38806e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3a815eb90 tx=0x7fe390009040 comp rx=0 tx=0).stop 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 msgr2=0x7fe3a815b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 0x7fe3a815b330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000efc0 tx=0x7fe3a000c490 comp rx=0 tx=0).stop 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 shutdown_connections 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe38806be30 0x7fe38806e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3a81602f0 0x7fe3a8143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3a80b16b0 0x7fe3a814fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 --2- 172.21.15.43:0/2998589180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a8072ae0 0x7fe3a815b330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 >> 172.21.15.43:0/2998589180 conn(0x7fe3a80b21f0 msgr2=0x7fe3a80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 shutdown_connections 2024-06-13T11:37:04.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.307+0000 7fe3ac963640 1 -- 172.21.15.43:0/2998589180 wait complete. 2024-06-13T11:37:04.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-13T11:37:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.430+0000 7f991e6ba640 1 Processor -- start 2024-06-13T11:37:04.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.430+0000 7f991e6ba640 1 -- start start 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991e6ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9918144c20 0x7f99180cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991e6ba640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f991815c9a0 0x7f9918072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991e6ba640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99180ccea0 con 0x7f99180721b0 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991e6ba640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9918145000 con 0x7f991815c9a0 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991e6ba640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f991815cea0 con 0x7f9918144c20 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991cc57640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f991815c9a0 0x7f9918072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991cc57640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f991815c9a0 0x7f9918072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34234/0 (socket says 172.21.15.43:34234) 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f99177fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f99180721b0 0x7f991815c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35950/0 (socket says 172.21.15.43:35950) 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f991cc57640 1 -- 172.21.15.43:0/3141580229 learned_addr learned my addr 172.21.15.43:0/3141580229 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.431+0000 7f9917fff640 1 --2- 172.21.15.43:0/3141580229 >> v2:172.21.15.53:3300/0 conn(0x7f9918144c20 0x7f99180cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f991cc57640 1 -- 172.21.15.43:0/3141580229 >> v2:172.21.15.53:3300/0 conn(0x7f9918144c20 msgr2=0x7f99180cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:04.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f991cc57640 1 --2- 172.21.15.43:0/3141580229 >> v2:172.21.15.53:3300/0 conn(0x7f9918144c20 0x7f99180cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f991cc57640 1 -- 172.21.15.43:0/3141580229 >> v1:172.21.15.43:6789/0 conn(0x7f99180721b0 legacy=0x7f991815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f991cc57640 1 -- 172.21.15.43:0/3141580229 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991815d180 con 0x7f991815c9a0 2024-06-13T11:37:04.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f9916ffd640 1 -- 172.21.15.43:0/3141580229 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769265950 0 0) 0x7f99180ccea0 con 0x7f99180721b0 2024-06-13T11:37:04.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f9917fff640 1 --2- 172.21.15.43:0/3141580229 >> v2:172.21.15.53:3300/0 conn(0x7f9918144c20 0x7f99180cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:04.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f991cc57640 1 --2- 172.21.15.43:0/3141580229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f991815c9a0 0x7f9918072640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f991806b7b0 tx=0x7f991002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20832d0a85f8092f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f9916ffd640 1 -- 172.21.15.43:0/3141580229 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991000b2d0 con 0x7f991815c9a0 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f9916ffd640 1 -- 172.21.15.43:0/3141580229 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991000b470 con 0x7f991815c9a0 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.432+0000 7f9916ffd640 1 -- 172.21.15.43:0/3141580229 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910009820 con 0x7f991815c9a0 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 -- 172.21.15.43:0/3141580229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f991815c9a0 msgr2=0x7f9918072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3141580229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f991815c9a0 0x7f9918072640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f991806b7b0 tx=0x7f991002c8b0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 -- 172.21.15.43:0/3141580229 shutdown_connections 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3141580229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f991815c9a0 0x7f9918072640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3141580229 >> v2:172.21.15.53:3300/0 conn(0x7f9918144c20 0x7f99180cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 -- 172.21.15.43:0/3141580229 >> 172.21.15.43:0/3141580229 conn(0x7f99180b14b0 msgr2=0x7f99180b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 -- 172.21.15.43:0/3141580229 shutdown_connections 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.433+0000 7f991e6ba640 1 -- 172.21.15.43:0/3141580229 wait complete. 2024-06-13T11:37:04.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.434+0000 7f991e6ba640 1 Processor -- start 2024-06-13T11:37:04.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.434+0000 7f991e6ba640 1 -- start start 2024-06-13T11:37:04.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991e6ba640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 0x7f99180aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991e6ba640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9918144c20 0x7f991815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991e6ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f991815c9a0 0x7f991813ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991e6ba640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f991815da20 con 0x7f99180721b0 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991e6ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f991815d740 con 0x7f991815c9a0 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991e6ba640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f991815df40 con 0x7f9918144c20 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f9917fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 0x7f99180aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f9917fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 0x7f99180aad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34246/0 (socket says 172.21.15.43:34246) 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f9917fff640 1 -- 172.21.15.43:0/3696917556 learned_addr learned my addr 172.21.15.43:0/3696917556 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f991cc57640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f991815c9a0 0x7f991813ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f99177fe640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9918144c20 0x7f991815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f9917fff640 1 -- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9918144c20 msgr2=0x7f991815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.435+0000 7f9917fff640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9918144c20 0x7f991815aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9917fff640 1 -- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f991815c9a0 msgr2=0x7f991813ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9917fff640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f991815c9a0 0x7f991813ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9917fff640 1 -- 172.21.15.43:0/3696917556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9918136c90 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f99177fe640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9918144c20 0x7f991815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9917fff640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 0x7f99180aad40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f990800ebe0 tx=0x7f990800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908017070 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990800cc30 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9918136f30 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908013470 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.436+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99181374f0 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.437+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991804ffb0 con 0x7f99180721b0 2024-06-13T11:37:04.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.438+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f990801a070 con 0x7f99180721b0 2024-06-13T11:37:04.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.438+0000 7f9914ff9640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f990406be60 0x7f990406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.438+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f990808acc0 con 0x7f99180721b0 2024-06-13T11:37:04.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.438+0000 7f99177fe640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f990406be60 0x7f990406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.439+0000 7f99177fe640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f990406be60 0x7f990406e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9918136920 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.443+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9908059400 con 0x7f99180721b0 2024-06-13T11:37:04.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.628+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f99180b3430 con 0x7f99180721b0 2024-06-13T11:37:04.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.628+0000 7f9914ff9640 1 -- 172.21.15.43:0/3696917556 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f990805d700 con 0x7f99180721b0 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:04.628 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f990406be60 msgr2=0x7f990406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f990406be60 0x7f990406e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9918136920 tx=0x7f990c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 msgr2=0x7f99180aad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 0x7f99180aad40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f990800ebe0 tx=0x7f990800c520 comp rx=0 tx=0).stop 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 shutdown_connections 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f990406be60 0x7f990406e320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f991815c9a0 0x7f991813ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9918144c20 0x7f991815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 --2- 172.21.15.43:0/3696917556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99180721b0 0x7f99180aad40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 >> 172.21.15.43:0/3696917556 conn(0x7f99180b14b0 msgr2=0x7f991806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 shutdown_connections 2024-06-13T11:37:04.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.630+0000 7f991e6ba640 1 -- 172.21.15.43:0/3696917556 wait complete. 2024-06-13T11:37:04.640 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-13T11:37:04.640 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-13T11:37:04.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.748+0000 7f64f3914640 1 Processor -- start 2024-06-13T11:37:04.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.748+0000 7f64f3914640 1 -- start start 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f3914640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64ec070810 0x7f64ec070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f3914640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f64ec0b55e0 0x7f64ec0b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f3914640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ec15e760 con 0x7f64ec15e380 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f3914640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec06db40 con 0x7f64ec0b55e0 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f3914640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec0711b0 con 0x7f64ec070810 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f1eb1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f64ec0b55e0 0x7f64ec0b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f16b0640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f64ec15e380 0x7f64ec0ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35958/0 (socket says 172.21.15.43:35958) 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.749+0000 7f64f16b0640 1 -- 172.21.15.43:0/3590423324 learned_addr learned my addr 172.21.15.43:0/3590423324 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64f1eb1640 1 -- 172.21.15.43:0/3590423324 >> v2:172.21.15.53:3300/0 conn(0x7f64ec070810 msgr2=0x7f64ec070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64f0eaf640 1 --2- 172.21.15.43:0/3590423324 >> v2:172.21.15.53:3300/0 conn(0x7f64ec070810 0x7f64ec070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64f1eb1640 1 --2- 172.21.15.43:0/3590423324 >> v2:172.21.15.53:3300/0 conn(0x7f64ec070810 0x7f64ec070c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64ebfff640 1 -- 172.21.15.43:0/3590423324 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891112739 0 0) 0x7f64ec15e760 con 0x7f64ec15e380 2024-06-13T11:37:04.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64f1eb1640 1 -- 172.21.15.43:0/3590423324 >> v1:172.21.15.43:6789/0 conn(0x7f64ec15e380 legacy=0x7f64ec0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64f1eb1640 1 -- 172.21.15.43:0/3590423324 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec06dd70 con 0x7f64ec0b55e0 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.750+0000 7f64f1eb1640 1 --2- 172.21.15.43:0/3590423324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec0b55e0 0x7f64ec0b5a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b2d50 tx=0x7f64dc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa9ab6fb9c9b6c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64ebfff640 1 -- 172.21.15.43:0/3590423324 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc007740 con 0x7f64ec0b55e0 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64ebfff640 1 -- 172.21.15.43:0/3590423324 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc0078e0 con 0x7f64ec0b55e0 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64ebfff640 1 -- 172.21.15.43:0/3590423324 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc007cb0 con 0x7f64ec0b55e0 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 -- 172.21.15.43:0/3590423324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec0b55e0 msgr2=0x7f64ec0b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 --2- 172.21.15.43:0/3590423324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec0b55e0 0x7f64ec0b5a30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b2d50 tx=0x7f64dc02a680 comp rx=0 tx=0).stop 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 -- 172.21.15.43:0/3590423324 shutdown_connections 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 --2- 172.21.15.43:0/3590423324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec0b55e0 0x7f64ec0b5a30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 --2- 172.21.15.43:0/3590423324 >> v2:172.21.15.53:3300/0 conn(0x7f64ec070810 0x7f64ec070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 -- 172.21.15.43:0/3590423324 >> 172.21.15.43:0/3590423324 conn(0x7f64ec072020 msgr2=0x7f64ec072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 -- 172.21.15.43:0/3590423324 shutdown_connections 2024-06-13T11:37:04.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.751+0000 7f64f3914640 1 -- 172.21.15.43:0/3590423324 wait complete. 2024-06-13T11:37:04.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.752+0000 7f64f3914640 1 Processor -- start 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.752+0000 7f64f3914640 1 -- start start 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f3914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 0x7f64ec1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f3914640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64ec0b55e0 0x7f64ec15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f3914640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64ec15e380 0x7f64ec159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f3914640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec06e610 con 0x7f64ec070810 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f3914640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec06e330 con 0x7f64ec0b55e0 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f3914640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec06e8f0 con 0x7f64ec15e380 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 0x7f64ec1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 0x7f64ec1f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34268/0 (socket says 172.21.15.43:34268) 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 -- 172.21.15.43:0/3227108719 learned_addr learned my addr 172.21.15.43:0/3227108719 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f0eaf640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64ec0b55e0 0x7f64ec15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f1eb1640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64ec15e380 0x7f64ec159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 -- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64ec15e380 msgr2=0x7f64ec159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64ec15e380 0x7f64ec159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 -- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64ec0b55e0 msgr2=0x7f64ec15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64ec0b55e0 0x7f64ec15bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f16b0640 1 -- 172.21.15.43:0/3227108719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec14e9e0 con 0x7f64ec070810 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.753+0000 7f64f0eaf640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64ec0b55e0 0x7f64ec15bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.754+0000 7f64f16b0640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 0x7f64ec1f3400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c460 tx=0x7f64e400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.754+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4018070 con 0x7f64ec070810 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.754+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4007500 con 0x7f64ec070810 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.754+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec14ecc0 con 0x7f64ec070810 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.754+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4004a20 con 0x7f64ec070810 2024-06-13T11:37:04.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.754+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec1f3940 con 0x7f64ec070810 2024-06-13T11:37:04.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.755+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec04ffb0 con 0x7f64ec070810 2024-06-13T11:37:04.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.756+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64e401b070 con 0x7f64ec070810 2024-06-13T11:37:04.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.756+0000 7f64e9ffb640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f64d806be30 0x7f64d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:04.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.756+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f64e4089dd0 con 0x7f64ec070810 2024-06-13T11:37:04.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.756+0000 7f64f0eaf640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f64d806be30 0x7f64d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:04.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.756+0000 7f64f0eaf640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f64d806be30 0x7f64d806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0d0380 tx=0x7f64e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:04.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.760+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f64e4058ac0 con 0x7f64ec070810 2024-06-13T11:37:04.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:04.946+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f64ec1619a0 con 0x7f64ec070810 2024-06-13T11:37:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.774+0000 7f64e9ffb640 1 -- 172.21.15.43:0/3227108719 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f64e40583c0 con 0x7f64ec070810 2024-06-13T11:37:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-06-13T11:37:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.777+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f64d806be30 msgr2=0x7f64d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.777+0000 7f64f3914640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f64d806be30 0x7f64d806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0d0380 tx=0x7f64e0008040 comp rx=0 tx=0).stop 2024-06-13T11:37:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.777+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 msgr2=0x7f64ec1f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.777+0000 7f64f3914640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 0x7f64ec1f3400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c460 tx=0x7f64e400c920 comp rx=0 tx=0).stop 2024-06-13T11:37:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 shutdown_connections 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f64d806be30 0x7f64d806e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f64ec15e380 0x7f64ec159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64ec0b55e0 0x7f64ec15bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 --2- 172.21.15.43:0/3227108719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec070810 0x7f64ec1f3400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 >> 172.21.15.43:0/3227108719 conn(0x7f64ec072020 msgr2=0x7f64ec0adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 shutdown_connections 2024-06-13T11:37:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.778+0000 7f64f3914640 1 -- 172.21.15.43:0/3227108719 wait complete. 2024-06-13T11:37:05.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-13T11:37:05.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.912+0000 7f7111d68640 1 Processor -- start 2024-06-13T11:37:05.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.912+0000 7f7111d68640 1 -- start start 2024-06-13T11:37:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.912+0000 7f7111d68640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c143ff0 0x7f710c0d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f7111d68640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0ae980 con 0x7f710c0ae5a0 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f7111d68640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0d30e0 con 0x7f710c0d2910 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f7111d68640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0d33c0 con 0x7f710c143ff0 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710b7fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f710c0ae5a0 0x7f710c1438e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35960/0 (socket says 172.21.15.43:35960) 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710b7fe640 1 -- 172.21.15.43:0/1565454271 learned_addr learned my addr 172.21.15.43:0/1565454271 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710affd640 1 --2- 172.21.15.43:0/1565454271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c143ff0 0x7f710c0d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394331570 0 0) 0x7f710c0ae980 con 0x7f710c0ae5a0 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f4003520 con 0x7f710c0ae5a0 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520177195 0 0) 0x7f710c0d30e0 con 0x7f710c0d2910 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f710c0ae980 con 0x7f710c0d2910 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 685212545 0 0) 0x7f70f4003520 con 0x7f710c0ae5a0 2024-06-13T11:37:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710affd640 1 -- 172.21.15.43:0/1565454271 >> v1:172.21.15.53:6789/0 conn(0x7f710c0d2910 legacy=0x7f710c141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710affd640 1 -- 172.21.15.43:0/1565454271 >> v1:172.21.15.43:6789/0 conn(0x7f710c0ae5a0 legacy=0x7f710c1438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.913+0000 7f710affd640 1 -- 172.21.15.43:0/1565454271 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0d36a0 con 0x7f710c143ff0 2024-06-13T11:37:05.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.914+0000 7f710affd640 1 --2- 172.21.15.43:0/1565454271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c143ff0 0x7f710c0d23d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71000097d0 tx=0x7f710002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e7ee3915f21ef8d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:05.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.914+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100037070 con 0x7f710c143ff0 2024-06-13T11:37:05.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.914+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710002ac30 con 0x7f710c143ff0 2024-06-13T11:37:05.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.914+0000 7f710a7fc640 1 -- 172.21.15.43:0/1565454271 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc001670 con 0x7f710c143ff0 2024-06-13T11:37:05.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 -- 172.21.15.43:0/1565454271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c143ff0 msgr2=0x7f710c0d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 --2- 172.21.15.43:0/1565454271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c143ff0 0x7f710c0d23d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71000097d0 tx=0x7f710002a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 -- 172.21.15.43:0/1565454271 shutdown_connections 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 --2- 172.21.15.43:0/1565454271 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c143ff0 0x7f710c0d23d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 -- 172.21.15.43:0/1565454271 >> 172.21.15.43:0/1565454271 conn(0x7f710c072d60 msgr2=0x7f710c073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 -- 172.21.15.43:0/1565454271 shutdown_connections 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.915+0000 7f7111d68640 1 -- 172.21.15.43:0/1565454271 wait complete. 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.916+0000 7f7111d68640 1 Processor -- start 2024-06-13T11:37:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.916+0000 7f7111d68640 1 -- start start 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f7111d68640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c0ae5a0 0x7f710c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f7111d68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 0x7f710c133b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f7111d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710c143ff0 0x7f710c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f7111d68640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0d2d80 con 0x7f710c0d2910 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f7111d68640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0d3c60 con 0x7f710c143ff0 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f7111d68640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f710c142110 con 0x7f710c0ae5a0 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 0x7f710c133b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 0x7f710c133b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34276/0 (socket says 172.21.15.43:34276) 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 -- 172.21.15.43:0/848925384 learned_addr learned my addr 172.21.15.43:0/848925384 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710b7fe640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c0ae5a0 0x7f710c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 -- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c0ae5a0 msgr2=0x7f710c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710bfff640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710c143ff0 0x7f710c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c0ae5a0 0x7f710c158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 -- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710c143ff0 msgr2=0x7f710c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710c143ff0 0x7f710c158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.917+0000 7f710affd640 1 -- 172.21.15.43:0/848925384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0b0ae0 con 0x7f710c0d2910 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.918+0000 7f710affd640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 0x7f710c133b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71000097d0 tx=0x7f71000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.918+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100037050 con 0x7f710c0d2910 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.918+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100043070 con 0x7f710c0d2910 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.918+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c0b0520 con 0x7f710c0d2910 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.918+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710003ca50 con 0x7f710c0d2910 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.918+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c0acbb0 con 0x7f710c0d2910 2024-06-13T11:37:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.919+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c04ffb0 con 0x7f710c0d2910 2024-06-13T11:37:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.919+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f710003cbf0 con 0x7f710c0d2910 2024-06-13T11:37:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.920+0000 7f70f3fff640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f70f806be30 0x7f70f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.920+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f71000ab7d0 con 0x7f710c0d2910 2024-06-13T11:37:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.920+0000 7f710b7fe640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f70f806be30 0x7f70f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.921+0000 7f710b7fe640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f70f806be30 0x7f70f806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0011e0 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:05.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:05.925+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7100046360 con 0x7f710c0d2910 2024-06-13T11:37:06.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.110+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f710c161920 con 0x7f710c0d2910 2024-06-13T11:37:06.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.776+0000 7f70f3fff640 1 -- 172.21.15.43:0/848925384 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f710007a510 con 0x7f710c0d2910 2024-06-13T11:37:06.776 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-06-13T11:37:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.781+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f70f806be30 msgr2=0x7f70f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.781+0000 7f7111d68640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f70f806be30 0x7f70f806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0011e0 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.781+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 msgr2=0x7f710c133b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.781+0000 7f7111d68640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 0x7f710c133b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71000097d0 tx=0x7f71000046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.782+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 shutdown_connections 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.782+0000 7f7111d68640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f70f806be30 0x7f70f806e2f0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0011e0 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.782+0000 7f7111d68640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710c143ff0 0x7f710c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.782+0000 7f7111d68640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710c0d2910 0x7f710c133b70 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71000097d0 tx=0x7f71000046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.782+0000 7f7111d68640 1 --2- 172.21.15.43:0/848925384 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f710c0ae5a0 0x7f710c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.782+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 >> 172.21.15.43:0/848925384 conn(0x7f710c072d60 msgr2=0x7f710c15f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.783+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 shutdown_connections 2024-06-13T11:37:06.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.783+0000 7f7111d68640 1 -- 172.21.15.43:0/848925384 wait complete. 2024-06-13T11:37:06.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-13T11:37:06.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.923+0000 7ffbb68cd640 1 Processor -- start 2024-06-13T11:37:06.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.923+0000 7ffbb68cd640 1 -- start start 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.923+0000 7ffbb68cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbb015e460 0x7ffbb00aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.923+0000 7ffbb68cd640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb00d3630 con 0x7ffbb00d1cd0 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.923+0000 7ffbb68cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb00d3910 con 0x7ffbb00ae200 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.923+0000 7ffbb68cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ffbb00d3bf0 con 0x7ffbb015e460 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbb4e6a640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffbb00d1cd0 0x7ffbb01621a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35972/0 (socket says 172.21.15.43:35972) 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbb4e6a640 1 -- 172.21.15.43:0/3966596124 learned_addr learned my addr 172.21.15.43:0/3966596124 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaffff640 1 --2- 172.21.15.43:0/3966596124 >> v2:172.21.15.53:3300/0 conn(0x7ffbb015e460 0x7ffbb00aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394429769 0 0) 0x7ffbb00d3630 con 0x7ffbb00d1cd0 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb9c003520 con 0x7ffbb00d1cd0 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3286729294 0 0) 0x7ffb9c003520 con 0x7ffbb00d1cd0 2024-06-13T11:37:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 >> v2:172.21.15.53:3300/0 conn(0x7ffbb015e460 msgr2=0x7ffbb00aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 --2- 172.21.15.43:0/3966596124 >> v2:172.21.15.53:3300/0 conn(0x7ffbb015e460 0x7ffbb00aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 >> v1:172.21.15.53:6789/0 conn(0x7ffbb00ae200 legacy=0x7ffbb00d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb00d3ed0 con 0x7ffbb00d1cd0 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7ffba80019f0 con 0x7ffbb00d1cd0 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 >> v1:172.21.15.43:6789/0 conn(0x7ffbb00d1cd0 legacy=0x7ffbb01621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb9c0039b0 0x7ffb9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffb9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb9c0051c0 0x7ffb9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb00d3bf0 con 0x7ffb9c004800 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c00c160 con 0x7ffb9c0051c0 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c00c360 con 0x7ffb9c0039b0 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffba7fff640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffb9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.924+0000 7ffbaffff640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb9c0039b0 0x7ffb9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffbb4e6a640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb9c0051c0 0x7ffb9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffba7fff640 1 -- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb9c0039b0 msgr2=0x7ffb9c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffba7fff640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffb9c0039b0 0x7ffb9c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffba7fff640 1 -- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb9c0051c0 msgr2=0x7ffb9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffba7fff640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb9c0051c0 0x7ffb9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffba7fff640 1 -- 172.21.15.43:0/3966596124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c003520 con 0x7ffb9c004800 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffbb4e6a640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb9c0051c0 0x7ffb9c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffbb4e6a640 1 -- 172.21.15.43:0/3966596124 reap_dead start 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.925+0000 7ffba7fff640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffb9c004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffb98001750 tx=0x7ffb9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb201a4364bbe554 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98001370 con 0x7ffb9c004800 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb980052d0 con 0x7ffb9c004800 2024-06-13T11:37:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbaf7fe640 1 -- 172.21.15.43:0/3966596124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9802abc0 con 0x7ffb9c004800 2024-06-13T11:37:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 -- 172.21.15.43:0/3966596124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 msgr2=0x7ffb9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffb9c004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffb98001750 tx=0x7ffb9c005830 comp rx=0 tx=0).stop 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 -- 172.21.15.43:0/3966596124 shutdown_connections 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/3966596124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffb9c004c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 -- 172.21.15.43:0/3966596124 >> 172.21.15.43:0/3966596124 conn(0x7ffbb00673d0 msgr2=0x7ffbb00d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 -- 172.21.15.43:0/3966596124 shutdown_connections 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.926+0000 7ffbb68cd640 1 -- 172.21.15.43:0/3966596124 wait complete. 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.927+0000 7ffbb68cd640 1 Processor -- start 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.927+0000 7ffbb68cd640 1 -- start start 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb68cd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffbb014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb68cd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbb015f260 0x7ffbb015f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb68cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb0154550 0x7ffbb01549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb68cd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb00ae7e0 con 0x7ffb9c004800 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb68cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb00ae660 con 0x7ffbb0154550 2024-06-13T11:37:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb68cd640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb00ae960 con 0x7ffbb015f260 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffbb014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffbb014ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34288/0 (socket says 172.21.15.43:34288) 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbaffff640 1 -- 172.21.15.43:0/2679517129 learned_addr learned my addr 172.21.15.43:0/2679517129 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffbb4e6a640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb0154550 0x7ffbb01549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.928+0000 7ffba7fff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbb015f260 0x7ffbb015f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbaffff640 1 -- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbb015f260 msgr2=0x7ffbb015f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbaffff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbb015f260 0x7ffbb015f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbaffff640 1 -- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb0154550 msgr2=0x7ffbb01549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbaffff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb0154550 0x7ffbb01549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbaffff640 1 -- 172.21.15.43:0/2679517129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb015fd60 con 0x7ffb9c004800 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffba7fff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbb015f260 0x7ffbb015f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbaffff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffbb014ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffba0011ad0 tx=0x7ffba0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba000fbb0 con 0x7ffb9c004800 2024-06-13T11:37:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba000fd50 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb0160040 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0014660 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.929+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb0160600 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.930+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb004ffb0 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.931+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffba0012040 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.931+0000 7ffbad7fa640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffb9006be30 0x7ffb9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.931+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7ffba008b500 con 0x7ffb9c004800 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.931+0000 7ffba7fff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffb9006be30 0x7ffb9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.932+0000 7ffba7fff640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffb9006be30 0x7ffb9006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb98032000 tx=0x7ffb9802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:06.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:06.936+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffba0019030 con 0x7ffb9c004800 2024-06-13T11:37:07.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.165+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ffbb00ab700 con 0x7ffb9c004800 2024-06-13T11:37:07.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.797+0000 7ffbad7fa640 1 -- 172.21.15.43:0/2679517129 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ffba0059f10 con 0x7ffb9c004800 2024-06-13T11:37:07.798 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 2 and data pool 3 2024-06-13T11:37:07.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.810+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffb9006be30 msgr2=0x7ffb9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.810+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffb9006be30 0x7ffb9006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb98032000 tx=0x7ffb9802e000 comp rx=0 tx=0).stop 2024-06-13T11:37:07.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.810+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 msgr2=0x7ffbb014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.810+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffbb014ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffba0011ad0 tx=0x7ffba0011f90 comp rx=0 tx=0).stop 2024-06-13T11:37:07.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.812+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 shutdown_connections 2024-06-13T11:37:07.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.812+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffb9006be30 0x7ffb9006e2f0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb98032000 tx=0x7ffb9802e000 comp rx=0 tx=0).stop 2024-06-13T11:37:07.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.812+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb0154550 0x7ffbb01549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.812+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbb015f260 0x7ffbb015f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.812+0000 7ffbb68cd640 1 --2- 172.21.15.43:0/2679517129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb9c004800 0x7ffbb014ebf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.812+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 >> 172.21.15.43:0/2679517129 conn(0x7ffbb00673d0 msgr2=0x7ffbb00ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:07.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.814+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 shutdown_connections 2024-06-13T11:37:07.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.815+0000 7ffbb68cd640 1 -- 172.21.15.43:0/2679517129 wait complete. 2024-06-13T11:37:07.833 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-13T11:37:07.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-13T11:37:07.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.948+0000 7fc5431c8640 1 Processor -- start 2024-06-13T11:37:07.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.948+0000 7fc5431c8640 1 -- start start 2024-06-13T11:37:07.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc5431c8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc53c1473a0 0x7fc53c162150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc5431c8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c0ae3e0 con 0x7fc53c071fa0 2024-06-13T11:37:07.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc5431c8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c0ae6c0 con 0x7fc53c162690 2024-06-13T11:37:07.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc5431c8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc53c0ae1b0 con 0x7fc53c1473a0 2024-06-13T11:37:07.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc541765640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc53c071fa0 0x7fc53c0af480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35984/0 (socket says 172.21.15.43:35984) 2024-06-13T11:37:07.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc541765640 1 -- 172.21.15.43:0/2833669459 learned_addr learned my addr 172.21.15.43:0/2833669459 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:07.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc540f64640 1 --2- 172.21.15.43:0/2833669459 >> v2:172.21.15.53:3300/0 conn(0x7fc53c1473a0 0x7fc53c162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755525218 0 0) 0x7fc53c0ae3e0 con 0x7fc53c071fa0 2024-06-13T11:37:07.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.949+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc524003520 con 0x7fc53c071fa0 2024-06-13T11:37:07.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 88939366 0 0) 0x7fc524003520 con 0x7fc53c071fa0 2024-06-13T11:37:07.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 >> v2:172.21.15.53:3300/0 conn(0x7fc53c1473a0 msgr2=0x7fc53c162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:07.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 --2- 172.21.15.43:0/2833669459 >> v2:172.21.15.53:3300/0 conn(0x7fc53c1473a0 0x7fc53c162150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 >> v1:172.21.15.53:6789/0 conn(0x7fc53c162690 legacy=0x7fc53c071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c0ae9a0 con 0x7fc53c071fa0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fc5340019f0 con 0x7fc53c071fa0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 >> v1:172.21.15.43:6789/0 conn(0x7fc53c071fa0 legacy=0x7fc53c0af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5240039b0 0x7fc524003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc524004800 0x7fc524004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5240051c0 0x7fc52400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc52400c030 con 0x7fc524004800 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc52400c1e0 con 0x7fc5240039b0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc52400c3e0 con 0x7fc5240051c0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53bfff640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc524004800 0x7fc524004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc540f64640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5240039b0 0x7fc524003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc541765640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5240051c0 0x7fc52400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53bfff640 1 -- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5240051c0 msgr2=0x7fc52400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53bfff640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5240051c0 0x7fc52400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53bfff640 1 -- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5240039b0 msgr2=0x7fc524003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53bfff640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5240039b0 0x7fc524003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc53bfff640 1 -- 172.21.15.43:0/2833669459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc524003520 con 0x7fc524004800 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.950+0000 7fc541765640 1 -- 172.21.15.43:0/2833669459 reap_dead start 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.951+0000 7fc53bfff640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc524004800 0x7fc524004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc530001750 tx=0x7fc524005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38935e71c418f1f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.951+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530001370 con 0x7fc524004800 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.951+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5300052d0 con 0x7fc524004800 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.951+0000 7fc53b7fe640 1 -- 172.21.15.43:0/2833669459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53002abe0 con 0x7fc524004800 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 -- 172.21.15.43:0/2833669459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc524004800 msgr2=0x7fc524004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc524004800 0x7fc524004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc530001750 tx=0x7fc524005830 comp rx=0 tx=0).stop 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 -- 172.21.15.43:0/2833669459 shutdown_connections 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 --2- 172.21.15.43:0/2833669459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc524004800 0x7fc524004c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 -- 172.21.15.43:0/2833669459 >> 172.21.15.43:0/2833669459 conn(0x7fc53c06cc10 msgr2=0x7fc53c06d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:07.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 -- 172.21.15.43:0/2833669459 shutdown_connections 2024-06-13T11:37:07.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.952+0000 7fc5431c8640 1 -- 172.21.15.43:0/2833669459 wait complete. 2024-06-13T11:37:07.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.953+0000 7fc5431c8640 1 Processor -- start 2024-06-13T11:37:07.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.953+0000 7fc5431c8640 1 -- start start 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5431c8640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc524004800 0x7fc53c13bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5431c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c13d140 0x7fc53c1e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5431c8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 0x7fc53c1e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5431c8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c0aef60 con 0x7fc53c13d5c0 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5431c8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c162150 con 0x7fc53c13d140 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5431c8640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc53c1622d0 con 0x7fc524004800 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 0x7fc53c1e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 0x7fc53c1e88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34316/0 (socket says 172.21.15.43:34316) 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 -- 172.21.15.43:0/633732159 learned_addr learned my addr 172.21.15.43:0/633732159 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc53bfff640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c13d140 0x7fc53c1e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc540f64640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc524004800 0x7fc53c13bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 -- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc524004800 msgr2=0x7fc53c13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc524004800 0x7fc53c13bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 -- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c13d140 msgr2=0x7fc53c1e83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c13d140 0x7fc53c1e83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 -- 172.21.15.43:0/633732159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c15ec70 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc53bfff640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c13d140 0x7fc53c1e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc541765640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 0x7fc53c1e88e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc534002050 tx=0x7fc534007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.954+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400ab00 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.955+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc534018070 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.955+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53c15ef50 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.955+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5340133f0 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.955+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53c1e9800 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.956+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c04ffb0 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.956+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc534013590 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.957+0000 7fc5397fa640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc52806be30 0x7fc52806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.957+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc53408b430 con 0x7fc53c13d5c0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.957+0000 7fc540f64640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc52806be30 0x7fc52806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:07.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.957+0000 7fc540f64640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc52806be30 0x7fc52806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc53c146970 tx=0x7fc52c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:07.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:07.961+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc534059d60 con 0x7fc53c13d5c0 2024-06-13T11:37:08.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.157+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc53c073080 con 0x7fc53c13d5c0 2024-06-13T11:37:08.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.800+0000 7fc5397fa640 1 -- 172.21.15.43:0/633732159 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fc534059660 con 0x7fc53c13d5c0 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc52806be30 msgr2=0x7fc52806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc52806be30 0x7fc52806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc53c146970 tx=0x7fc52c008040 comp rx=0 tx=0).stop 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 msgr2=0x7fc53c1e88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 0x7fc53c1e88e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc534002050 tx=0x7fc534007b20 comp rx=0 tx=0).stop 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 shutdown_connections 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc52806be30 0x7fc52806e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc53c13d5c0 0x7fc53c1e88e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc53c13d140 0x7fc53c1e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 --2- 172.21.15.43:0/633732159 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc524004800 0x7fc53c13bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.804+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 >> 172.21.15.43:0/633732159 conn(0x7fc53c06cc10 msgr2=0x7fc53c1437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.805+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 shutdown_connections 2024-06-13T11:37:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.805+0000 7fc5431c8640 1 -- 172.21.15.43:0/633732159 wait complete. 2024-06-13T11:37:08.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-13T11:37:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.935+0000 7fcead226640 1 Processor -- start 2024-06-13T11:37:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.935+0000 7fcead226640 1 -- start start 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcead226640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcea813f120 0x7fcea80aa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcead226640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea80cf270 con 0x7fcea80cedb0 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcead226640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea80cf550 con 0x7fcea806baa0 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcead226640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcea80cfe80 con 0x7fcea813f120 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcea659c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcea80cedb0 0x7fcea806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36000/0 (socket says 172.21.15.43:36000) 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcea659c640 1 -- 172.21.15.43:0/3408877310 learned_addr learned my addr 172.21.15.43:0/3408877310 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.936+0000 7fcea6d9d640 1 --2- 172.21.15.43:0/3408877310 >> v2:172.21.15.53:3300/0 conn(0x7fcea813f120 0x7fcea80aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817344857 0 0) 0x7fcea80cf270 con 0x7fcea80cedb0 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce94003520 con 0x7fcea80cedb0 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2319141978 0 0) 0x7fce94003520 con 0x7fcea80cedb0 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 >> v2:172.21.15.53:3300/0 conn(0x7fcea813f120 msgr2=0x7fcea80aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 --2- 172.21.15.43:0/3408877310 >> v2:172.21.15.53:3300/0 conn(0x7fcea813f120 0x7fcea80aa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 >> v1:172.21.15.53:6789/0 conn(0x7fcea806baa0 legacy=0x7fcea80d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea80cf830 con 0x7fcea80cedb0 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fce90001670 con 0x7fcea80cedb0 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 >> v1:172.21.15.43:6789/0 conn(0x7fcea80cedb0 legacy=0x7fcea806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce940039b0 0x7fce94003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce94004800 0x7fce94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce940051c0 0x7fce9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcea80cfe80 con 0x7fce94004800 2024-06-13T11:37:08.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce9400c090 con 0x7fce940051c0 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fce9400c290 con 0x7fce940039b0 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea659c640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce94004800 0x7fce94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea6d9d640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce940039b0 0x7fce94003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea759e640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce940051c0 0x7fce9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea659c640 1 -- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce940039b0 msgr2=0x7fce94003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea659c640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fce940039b0 0x7fce94003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea659c640 1 -- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce940051c0 msgr2=0x7fce9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea659c640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce940051c0 0x7fce9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea659c640 1 -- 172.21.15.43:0/3408877310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce94003520 con 0x7fce94004800 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.937+0000 7fcea759e640 1 -- 172.21.15.43:0/3408877310 reap_dead start 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.938+0000 7fcea659c640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce94004800 0x7fce94004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcea80aab80 tx=0x7fce94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b51df60ab2e55f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.938+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90007d10 con 0x7fce94004800 2024-06-13T11:37:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.938+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce90005ad0 con 0x7fce94004800 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.938+0000 7fcea5d9b640 1 -- 172.21.15.43:0/3408877310 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90007070 con 0x7fce94004800 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 -- 172.21.15.43:0/3408877310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce94004800 msgr2=0x7fce94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce94004800 0x7fce94004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcea80aab80 tx=0x7fce94005830 comp rx=0 tx=0).stop 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 -- 172.21.15.43:0/3408877310 shutdown_connections 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 --2- 172.21.15.43:0/3408877310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce94004800 0x7fce94004c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 -- 172.21.15.43:0/3408877310 >> 172.21.15.43:0/3408877310 conn(0x7fcea8070f80 msgr2=0x7fcea806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 -- 172.21.15.43:0/3408877310 shutdown_connections 2024-06-13T11:37:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.939+0000 7fcead226640 1 -- 172.21.15.43:0/3408877310 wait complete. 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.940+0000 7fcead226640 1 Processor -- start 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.940+0000 7fcead226640 1 -- start start 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcead226640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce94004800 0x7fcea8138f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcead226640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcea8073730 0x7fcea813d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcead226640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 0x7fcea80b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcead226640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcea806b510 con 0x7fcea813d670 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcead226640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcea806b390 con 0x7fce94004800 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcead226640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcea806b690 con 0x7fcea8073730 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 0x7fcea80b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 0x7fcea80b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34330/0 (socket says 172.21.15.43:34330) 2024-06-13T11:37:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 -- 172.21.15.43:0/4035276828 learned_addr learned my addr 172.21.15.43:0/4035276828 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea6d9d640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce94004800 0x7fcea8138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea659c640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcea8073730 0x7fcea813d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 -- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcea8073730 msgr2=0x7fcea813d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcea8073730 0x7fcea813d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 -- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce94004800 msgr2=0x7fcea8138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce94004800 0x7fcea8138f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.941+0000 7fcea759e640 1 -- 172.21.15.43:0/4035276828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea813db80 con 0x7fcea813d670 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.942+0000 7fcea759e640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 0x7fcea80b0040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea80cfe30 tx=0x7fcea000f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.942+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea001a070 con 0x7fcea813d670 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.942+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea0005340 con 0x7fcea813d670 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.942+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea8072c50 con 0x7fcea813d670 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.942+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0007270 con 0x7fcea813d670 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.942+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea8073210 con 0x7fcea813d670 2024-06-13T11:37:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.943+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea804ffb0 con 0x7fcea813d670 2024-06-13T11:37:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.943+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcea001d070 con 0x7fcea813d670 2024-06-13T11:37:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.944+0000 7fce9f7fe640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fce8806be30 0x7fce8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.944+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fcea008a090 con 0x7fcea813d670 2024-06-13T11:37:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.944+0000 7fcea6d9d640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fce8806be30 0x7fce8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.944+0000 7fcea6d9d640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fce8806be30 0x7fce8806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce98007520 tx=0x7fce9800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:08.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:08.948+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcea00589a0 con 0x7fcea813d670 2024-06-13T11:37:09.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:09.135+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcea80b2580 con 0x7fcea813d670 2024-06-13T11:37:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.809+0000 7fce9f7fe640 1 -- 172.21.15.43:0/4035276828 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fcea00582a0 con 0x7fcea813d670 2024-06-13T11:37:10.809 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' created 2024-06-13T11:37:10.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fce8806be30 msgr2=0x7fce8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:10.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fce8806be30 0x7fce8806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce98007520 tx=0x7fce9800b040 comp rx=0 tx=0).stop 2024-06-13T11:37:10.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 msgr2=0x7fcea80b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:10.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 0x7fcea80b0040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea80cfe30 tx=0x7fcea000f900 comp rx=0 tx=0).stop 2024-06-13T11:37:10.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 shutdown_connections 2024-06-13T11:37:10.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fce8806be30 0x7fce8806e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcea813d670 0x7fcea80b0040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcea8073730 0x7fcea813d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 --2- 172.21.15.43:0/4035276828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce94004800 0x7fcea8138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.817+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 >> 172.21.15.43:0/4035276828 conn(0x7fcea8070f80 msgr2=0x7fcea80a9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:10.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.818+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 shutdown_connections 2024-06-13T11:37:10.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.818+0000 7fcead226640 1 -- 172.21.15.43:0/4035276828 wait complete. 2024-06-13T11:37:10.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-13T11:37:10.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.947+0000 7f6672fce640 1 Processor -- start 2024-06-13T11:37:10.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.947+0000 7f6672fce640 1 -- start start 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6672fce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f666c0ae980 0x7f666c0d2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6672fce640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 0x7f666c0d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6672fce640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666c0d35a0 con 0x7f666c0ae5a0 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6672fce640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f666c0d3880 con 0x7f666c0ae980 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6672fce640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f666c0d3b60 con 0x7f666c1624d0 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6670d6a640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f666c0ae5a0 0x7f666c161dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36006/0 (socket says 172.21.15.43:36006) 2024-06-13T11:37:10.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6670d6a640 1 -- 172.21.15.43:0/3333204001 learned_addr learned my addr 172.21.15.43:0/3333204001 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649620544 0 0) 0x7f666c0d35a0 con 0x7f666c0ae5a0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6654003520 con 0x7f666c0ae5a0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f667156b640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 0x7f666c0d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f6663fff640 1 --2- 172.21.15.43:0/3333204001 >> v2:172.21.15.53:3300/0 conn(0x7f666c0ae980 0x7f666c0d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1705264921 0 0) 0x7f6654003520 con 0x7f666c0ae5a0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 msgr2=0x7f666c0d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 0x7f666c0d2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 >> v2:172.21.15.53:3300/0 conn(0x7f666c0ae980 msgr2=0x7f666c0d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 --2- 172.21.15.43:0/3333204001 >> v2:172.21.15.53:3300/0 conn(0x7f666c0ae980 0x7f666c0d2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c0d3e40 con 0x7f666c0ae5a0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.948+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f6668001670 con 0x7f666c0ae5a0 2024-06-13T11:37:10.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 >> v1:172.21.15.43:6789/0 conn(0x7f666c0ae5a0 legacy=0x7f666c161dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 0x7f66540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654003f30 0x7f6654004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6654004d40 0x7f66540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0d3880 con 0x7f6654004d40 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0d3b60 con 0x7f6654003f30 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f665400b9c0 con 0x7f666c1624d0 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f667156b640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6654004d40 0x7f66540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f6670d6a640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 0x7f66540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f6663fff640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654003f30 0x7f6654004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f667156b640 1 -- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 msgr2=0x7f66540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f667156b640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1624d0 0x7f66540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f667156b640 1 -- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654003f30 msgr2=0x7f6654004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f667156b640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654003f30 0x7f6654004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.949+0000 7f667156b640 1 -- 172.21.15.43:0/3333204001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6654003520 con 0x7f6654004d40 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f667156b640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6654004d40 0x7f66540051c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f666c15f820 tx=0x7f6654005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3e9e7ee138a089 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664037070 con 0x7f6654004d40 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6664032410 con 0x7f6654004d40 2024-06-13T11:37:10.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f66637fe640 1 -- 172.21.15.43:0/3333204001 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664009c10 con 0x7f6654004d40 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f6672fce640 1 -- 172.21.15.43:0/3333204001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6654004d40 msgr2=0x7f66540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f6672fce640 1 --2- 172.21.15.43:0/3333204001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6654004d40 0x7f66540051c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f666c15f820 tx=0x7f6654005830 comp rx=0 tx=0).stop 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f667156b640 1 -- 172.21.15.43:0/3333204001 reap_dead start 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f6672fce640 1 -- 172.21.15.43:0/3333204001 shutdown_connections 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f6672fce640 1 -- 172.21.15.43:0/3333204001 >> 172.21.15.43:0/3333204001 conn(0x7f666c072fc0 msgr2=0x7f666c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f6672fce640 1 -- 172.21.15.43:0/3333204001 shutdown_connections 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.950+0000 7f6672fce640 1 -- 172.21.15.43:0/3333204001 wait complete. 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.952+0000 7f6672fce640 1 Processor -- start 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.952+0000 7f6672fce640 1 -- start start 2024-06-13T11:37:10.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654004d40 0x7f666c0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 0x7f666c1f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1f43a0 0x7f666c1f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0d3110 con 0x7f666c0b0fe0 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f666c0d2f90 con 0x7f6654004d40 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f666c0d3290 con 0x7f666c1f43a0 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 0x7f666c1f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 0x7f666c1f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34340/0 (socket says 172.21.15.43:34340) 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 -- 172.21.15.43:0/1826569901 learned_addr learned my addr 172.21.15.43:0/1826569901 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6670d6a640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654004d40 0x7f666c0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f667156b640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1f43a0 0x7f666c1f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 -- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1f43a0 msgr2=0x7f666c1f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1f43a0 0x7f666c1f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 -- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654004d40 msgr2=0x7f666c0b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654004d40 0x7f666c0b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 -- 172.21.15.43:0/1826569901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c1f4d60 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6663fff640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 0x7f666c1f3e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f665c011960 tx=0x7f665c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c00f9d0 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c00fb70 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c0b1760 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c014440 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.953+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c15e9c0 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.954+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c04ffb0 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.955+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f665c012040 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.955+0000 7f66617fa640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f665806be60 0x7f665806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.955+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f665c08b5c0 con 0x7f666c0b0fe0 2024-06-13T11:37:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.956+0000 7f6670d6a640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f665806be60 0x7f665806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.956+0000 7f6670d6a640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f665806be60 0x7f665806e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f666c140630 tx=0x7f66680078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:10.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:10.960+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f665c019030 con 0x7f666c0b0fe0 2024-06-13T11:37:11.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.143+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f666c0abc60 con 0x7f666c0b0fe0 2024-06-13T11:37:11.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.814+0000 7f66617fa640 1 -- 172.21.15.43:0/1826569901 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f665c059ce0 con 0x7f666c0b0fe0 2024-06-13T11:37:11.813 INFO:teuthology.orchestra.run.smithi043.stderr:set pool 4 allow_ec_overwrites to true 2024-06-13T11:37:11.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f665806be60 msgr2=0x7f665806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:11.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f665806be60 0x7f665806e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f666c140630 tx=0x7f66680078f0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 msgr2=0x7f666c1f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:11.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 0x7f666c1f3e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f665c011960 tx=0x7f665c011d60 comp rx=0 tx=0).stop 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 shutdown_connections 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f665806be60 0x7f665806e320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f666c1f43a0 0x7f666c1f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f666c0b0fe0 0x7f666c1f3e60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 --2- 172.21.15.43:0/1826569901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6654004d40 0x7f666c0b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 >> 172.21.15.43:0/1826569901 conn(0x7f666c072fc0 msgr2=0x7f666c13f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 shutdown_connections 2024-06-13T11:37:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.818+0000 7f6672fce640 1 -- 172.21.15.43:0/1826569901 wait complete. 2024-06-13T11:37:11.847 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-13T11:37:11.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.958+0000 7f4078676640 1 Processor -- start 2024-06-13T11:37:11.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.958+0000 7f4078676640 1 -- start start 2024-06-13T11:37:11.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4078676640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4070140bf0 0x7f40700cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:11.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4078676640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40700cf930 0x7f407006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4078676640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f407006d210 con 0x7f4070143bd0 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4078676640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f407006e7f0 con 0x7f4070140bf0 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4078676640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f407006d4f0 con 0x7f40700cf930 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4076412640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4070140bf0 0x7f40700cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4075c11640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4070143bd0 0x7f40700cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36016/0 (socket says 172.21.15.43:36016) 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4075c11640 1 -- 172.21.15.43:0/1460314896 learned_addr learned my addr 172.21.15.43:0/1460314896 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4076c13640 1 --2- 172.21.15.43:0/1460314896 >> v2:172.21.15.53:3300/0 conn(0x7f40700cf930 0x7f407006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4076412640 1 -- 172.21.15.43:0/1460314896 >> v2:172.21.15.53:3300/0 conn(0x7f40700cf930 msgr2=0x7f407006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4076412640 1 --2- 172.21.15.43:0/1460314896 >> v2:172.21.15.53:3300/0 conn(0x7f40700cf930 0x7f407006e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4076412640 1 -- 172.21.15.43:0/1460314896 >> v1:172.21.15.43:6789/0 conn(0x7f4070143bd0 legacy=0x7f40700cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:11.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.959+0000 7f4076412640 1 -- 172.21.15.43:0/1460314896 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407006d7d0 con 0x7f4070140bf0 2024-06-13T11:37:11.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.960+0000 7f4076412640 1 --2- 172.21.15.43:0/1460314896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f40700cd960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40700b2690 tx=0x7f406c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b126b50603d528a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:11.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.960+0000 7f4075410640 1 -- 172.21.15.43:0/1460314896 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c037070 con 0x7f4070140bf0 2024-06-13T11:37:11.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.960+0000 7f4075410640 1 -- 172.21.15.43:0/1460314896 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406c032440 con 0x7f4070140bf0 2024-06-13T11:37:11.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.960+0000 7f4075410640 1 -- 172.21.15.43:0/1460314896 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c032810 con 0x7f4070140bf0 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.960+0000 7f4078676640 1 -- 172.21.15.43:0/1460314896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 msgr2=0x7f40700cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.960+0000 7f4078676640 1 --2- 172.21.15.43:0/1460314896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f40700cd960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40700b2690 tx=0x7f406c02a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.961+0000 7f4078676640 1 -- 172.21.15.43:0/1460314896 shutdown_connections 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.961+0000 7f4078676640 1 --2- 172.21.15.43:0/1460314896 >> v2:172.21.15.53:3300/0 conn(0x7f40700cf930 0x7f407006e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.961+0000 7f4078676640 1 --2- 172.21.15.43:0/1460314896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f40700cd960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.961+0000 7f4078676640 1 -- 172.21.15.43:0/1460314896 >> 172.21.15.43:0/1460314896 conn(0x7f4070067610 msgr2=0x7f40700b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.961+0000 7f4078676640 1 -- 172.21.15.43:0/1460314896 shutdown_connections 2024-06-13T11:37:11.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.961+0000 7f4078676640 1 -- 172.21.15.43:0/1460314896 wait complete. 2024-06-13T11:37:11.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.962+0000 7f4078676640 1 Processor -- start 2024-06-13T11:37:11.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.962+0000 7f4078676640 1 -- start start 2024-06-13T11:37:11.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40700cf930 0x7f4070159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:11.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f407013f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:11.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4070143bd0 0x7f4070132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:11.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4070140fd0 con 0x7f4070140bf0 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f407006dd90 con 0x7f40700cf930 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f407006ce50 con 0x7f4070143bd0 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f407013f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f407013f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34364/0 (socket says 172.21.15.43:34364) 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4076412640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40700cf930 0x7f4070159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 -- 172.21.15.43:0/4267212777 learned_addr learned my addr 172.21.15.43:0/4267212777 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4076c13640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4070143bd0 0x7f4070132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 -- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4070143bd0 msgr2=0x7f4070132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4070143bd0 0x7f4070132570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 -- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40700cf930 msgr2=0x7f4070159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40700cf930 0x7f4070159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 -- 172.21.15.43:0/4267212777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4070141770 con 0x7f4070140bf0 2024-06-13T11:37:11.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4075c11640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f407013f1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f406000c430 tx=0x7f406000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:11.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060017070 con 0x7f4070140bf0 2024-06-13T11:37:11.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4060005ce0 con 0x7f4070140bf0 2024-06-13T11:37:11.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40600072f0 con 0x7f4070140bf0 2024-06-13T11:37:11.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4070141a50 con 0x7f4070140bf0 2024-06-13T11:37:11.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.963+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4070142010 con 0x7f4070140bf0 2024-06-13T11:37:11.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.964+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40700688c0 con 0x7f4070140bf0 2024-06-13T11:37:11.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.965+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f406001a070 con 0x7f4070140bf0 2024-06-13T11:37:11.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.966+0000 7f4066ffd640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f405406be30 0x7f405406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:11.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.966+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f406008a490 con 0x7f4070140bf0 2024-06-13T11:37:11.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.966+0000 7f4076412640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f405406be30 0x7f405406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:11.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.966+0000 7f4076412640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f405406be30 0x7f405406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f406c034000 tx=0x7f406c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:11.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:11.970+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40600584c0 con 0x7f4070140bf0 2024-06-13T11:37:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.202+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f407004ffb0 con 0x7f4070140bf0 2024-06-13T11:37:12.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.815+0000 7f4066ffd640 1 -- 172.21.15.43:0/4267212777 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f406005c7c0 con 0x7f4070140bf0 2024-06-13T11:37:12.815 INFO:teuthology.orchestra.run.smithi043.stderr:added data pool 4 to fsmap 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f405406be30 msgr2=0x7f405406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f405406be30 0x7f405406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f406c034000 tx=0x7f406c02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 msgr2=0x7f407013f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f407013f1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f406000c430 tx=0x7f406000c8f0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 shutdown_connections 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f405406be30 0x7f405406e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4070143bd0 0x7f4070132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4070140bf0 0x7f407013f1f0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f406000c430 tx=0x7f406000c8f0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 --2- 172.21.15.43:0/4267212777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40700cf930 0x7f4070159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 >> 172.21.15.43:0/4267212777 conn(0x7f4070067610 msgr2=0x7f407013b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 shutdown_connections 2024-06-13T11:37:12.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.819+0000 7f4078676640 1 -- 172.21.15.43:0/4267212777 wait complete. 2024-06-13T11:37:12.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.942+0000 7f4a9af61640 1 Processor -- start 2024-06-13T11:37:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.943+0000 7f4a9af61640 1 -- start start 2024-06-13T11:37:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.943+0000 7f4a9af61640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a940b7fb0 0x7f4a9415f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.943+0000 7f4a9af61640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a94071d50 con 0x7f4a94161e20 2024-06-13T11:37:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.943+0000 7f4a9af61640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a94162a00 con 0x7f4a940b6a70 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.943+0000 7f4a9af61640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9415ef90 con 0x7f4a940b7fb0 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a994fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4a94161e20 0x7f4a940b5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45012/0 (socket says 172.21.15.43:45012) 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a994fe640 1 -- 172.21.15.43:0/1572041240 learned_addr learned my addr 172.21.15.43:0/1572041240 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a93fff640 1 --2- 172.21.15.43:0/1572041240 >> v2:172.21.15.53:3300/0 conn(0x7f4a940b7fb0 0x7f4a9415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a937fe640 1 -- 172.21.15.43:0/1572041240 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 326844078 0 0) 0x7f4a94071d50 con 0x7f4a94161e20 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a937fe640 1 -- 172.21.15.43:0/1572041240 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a7c003520 con 0x7f4a94161e20 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a93fff640 1 -- 172.21.15.43:0/1572041240 >> v1:172.21.15.53:6789/0 conn(0x7f4a940b6a70 legacy=0x7f4a940b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a93fff640 1 -- 172.21.15.43:0/1572041240 >> v1:172.21.15.43:6789/0 conn(0x7f4a94161e20 legacy=0x7f4a940b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.944+0000 7f4a93fff640 1 -- 172.21.15.43:0/1572041240 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a94162ce0 con 0x7f4a940b7fb0 2024-06-13T11:37:12.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.945+0000 7f4a93fff640 1 --2- 172.21.15.43:0/1572041240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a9415f420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a880097a0 tx=0x7f4a8802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdaf0c3c67e05557 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:12.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.945+0000 7f4a937fe640 1 -- 172.21.15.43:0/1572041240 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88037070 con 0x7f4a940b7fb0 2024-06-13T11:37:12.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.945+0000 7f4a937fe640 1 -- 172.21.15.43:0/1572041240 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a88032440 con 0x7f4a940b7fb0 2024-06-13T11:37:12.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.945+0000 7f4a937fe640 1 -- 172.21.15.43:0/1572041240 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88032810 con 0x7f4a940b7fb0 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.945+0000 7f4a9af61640 1 -- 172.21.15.43:0/1572041240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 msgr2=0x7f4a9415f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.945+0000 7f4a9af61640 1 --2- 172.21.15.43:0/1572041240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a9415f420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a880097a0 tx=0x7f4a8802a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.946+0000 7f4a9af61640 1 -- 172.21.15.43:0/1572041240 shutdown_connections 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.946+0000 7f4a9af61640 1 --2- 172.21.15.43:0/1572041240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a9415f420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.946+0000 7f4a9af61640 1 -- 172.21.15.43:0/1572041240 >> 172.21.15.43:0/1572041240 conn(0x7f4a9406f110 msgr2=0x7f4a9406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.946+0000 7f4a9af61640 1 -- 172.21.15.43:0/1572041240 shutdown_connections 2024-06-13T11:37:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.946+0000 7f4a9af61640 1 -- 172.21.15.43:0/1572041240 wait complete. 2024-06-13T11:37:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.947+0000 7f4a9af61640 1 Processor -- start 2024-06-13T11:37:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.947+0000 7f4a9af61640 1 -- start start 2024-06-13T11:37:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a9af61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 0x7f4a941605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a9af61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a941f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a9af61640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4a94161e20 0x7f4a94159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a9af61640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a940b6e50 con 0x7f4a940b6a70 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a9af61640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9415ec20 con 0x7f4a940b7fb0 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a9af61640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4a94162290 con 0x7f4a94161e20 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 0x7f4a941605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 0x7f4a941605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36148/0 (socket says 172.21.15.43:36148) 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 -- 172.21.15.43:0/687194178 learned_addr learned my addr 172.21.15.43:0/687194178 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a93fff640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a941f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a994fe640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4a94161e20 0x7f4a94159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 -- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4a94161e20 msgr2=0x7f4a94159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4a94161e20 0x7f4a94159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 -- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 msgr2=0x7f4a941f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a941f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 -- 172.21.15.43:0/687194178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a941f4440 con 0x7f4a940b6a70 2024-06-13T11:37:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a98cfd640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 0x7f4a941605a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400c480 tx=0x7f4a8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a840052d0 con 0x7f4a940b6a70 2024-06-13T11:37:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.948+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a84005470 con 0x7f4a940b6a70 2024-06-13T11:37:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.949+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9415a1d0 con 0x7f4a940b6a70 2024-06-13T11:37:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.949+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a84012870 con 0x7f4a940b6a70 2024-06-13T11:37:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.949+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a941f4990 con 0x7f4a940b6a70 2024-06-13T11:37:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.949+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9404ffb0 con 0x7f4a940b6a70 2024-06-13T11:37:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.950+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a84012a10 con 0x7f4a940b6a70 2024-06-13T11:37:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.951+0000 7f4a917fa640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8006be30 0x7f4a8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.951+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4a8408ac50 con 0x7f4a940b6a70 2024-06-13T11:37:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.951+0000 7f4a93fff640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8006be30 0x7f4a8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.952+0000 7f4a93fff640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8006be30 0x7f4a8006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a88034000 tx=0x7f4a8802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:12.955+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4a84090020 con 0x7f4a940b6a70 2024-06-13T11:37:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.179+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a940b7330 con 0x7f4a940b6a70 2024-06-13T11:37:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.179+0000 7f4a917fa640 1 -- 172.21.15.43:0/687194178 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f4a84058d00 con 0x7f4a940b6a70 2024-06-13T11:37:13.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:13.179 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:12.203657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-06-13T11:37:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8006be30 msgr2=0x7f4a8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8006be30 0x7f4a8006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a88034000 tx=0x7f4a8802e000 comp rx=0 tx=0).stop 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 msgr2=0x7f4a941605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 0x7f4a941605a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400c480 tx=0x7f4a8400c940 comp rx=0 tx=0).stop 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 shutdown_connections 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8006be30 0x7f4a8006e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4a94161e20 0x7f4a94159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a940b7fb0 0x7f4a941f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 --2- 172.21.15.43:0/687194178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a940b6a70 0x7f4a941605a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 >> 172.21.15.43:0/687194178 conn(0x7f4a9406f110 msgr2=0x7f4a94074830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 shutdown_connections 2024-06-13T11:37:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.181+0000 7f4a9af61640 1 -- 172.21.15.43:0/687194178 wait complete. 2024-06-13T11:37:13.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:13.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.295+0000 7f9081fce640 1 Processor -- start 2024-06-13T11:37:13.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.295+0000 7f9081fce640 1 -- start start 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f9081fce640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0d1380 0x7f907c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f9081fce640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f907c0cf850 0x7f907c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f9081fce640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f907c0cffc0 con 0x7f907c147480 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f9081fce640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f907c071db0 con 0x7f907c0cf850 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f9081fce640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f907c0d02a0 con 0x7f907c0d1380 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f907c0cf850 0x7f907c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f907c0cf850 0x7f907c072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36164/0 (socket says 172.21.15.43:36164) 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 -- 172.21.15.43:0/481210356 learned_addr learned my addr 172.21.15.43:0/481210356 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907affd640 1 --2- 172.21.15.43:0/481210356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0d1380 0x7f907c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 -- 172.21.15.43:0/481210356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0d1380 msgr2=0x7f907c147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 --2- 172.21.15.43:0/481210356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0d1380 0x7f907c147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 -- 172.21.15.43:0/481210356 >> v1:172.21.15.53:6789/0 conn(0x7f907c147480 legacy=0x7f907c0d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.296+0000 7f907bfff640 1 -- 172.21.15.43:0/481210356 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c071a40 con 0x7f907c0cf850 2024-06-13T11:37:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.297+0000 7f907bfff640 1 --2- 172.21.15.43:0/481210356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0cf850 0x7f907c072240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9074009e50 tx=0x7f907402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc7c3d42af5cf1b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.297+0000 7f907a7fc640 1 -- 172.21.15.43:0/481210356 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074036070 con 0x7f907c0cf850 2024-06-13T11:37:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.297+0000 7f907a7fc640 1 -- 172.21.15.43:0/481210356 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074031600 con 0x7f907c0cf850 2024-06-13T11:37:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.297+0000 7f907a7fc640 1 -- 172.21.15.43:0/481210356 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90740319d0 con 0x7f907c0cf850 2024-06-13T11:37:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 -- 172.21.15.43:0/481210356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0cf850 msgr2=0x7f907c072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 --2- 172.21.15.43:0/481210356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0cf850 0x7f907c072240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9074009e50 tx=0x7f907402a710 comp rx=0 tx=0).stop 2024-06-13T11:37:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 -- 172.21.15.43:0/481210356 shutdown_connections 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 --2- 172.21.15.43:0/481210356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0cf850 0x7f907c072240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 --2- 172.21.15.43:0/481210356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0d1380 0x7f907c147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 -- 172.21.15.43:0/481210356 >> 172.21.15.43:0/481210356 conn(0x7f907c070810 msgr2=0x7f907c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 -- 172.21.15.43:0/481210356 shutdown_connections 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.298+0000 7f9081fce640 1 -- 172.21.15.43:0/481210356 wait complete. 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.299+0000 7f9081fce640 1 Processor -- start 2024-06-13T11:37:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.299+0000 7f9081fce640 1 -- start start 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f9081fce640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0cf850 0x7f907c1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f9081fce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 0x7f907c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f9081fce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907c147480 0x7f907c0c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f9081fce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f907c072780 con 0x7f907c0d1380 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f9081fce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f907c0ae340 con 0x7f907c147480 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f9081fce640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f907c072900 con 0x7f907c0cf850 2024-06-13T11:37:13.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 0x7f907c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 0x7f907c1429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36168/0 (socket says 172.21.15.43:36168) 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 -- 172.21.15.43:0/715887995 learned_addr learned my addr 172.21.15.43:0/715887995 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907bfff640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907c147480 0x7f907c0c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907b7fe640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0cf850 0x7f907c1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 -- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0cf850 msgr2=0x7f907c1434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0cf850 0x7f907c1434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 -- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907c147480 msgr2=0x7f907c0c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907c147480 0x7f907c0c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907affd640 1 -- 172.21.15.43:0/715887995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c1f51f0 con 0x7f907c0d1380 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907bfff640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907c147480 0x7f907c0c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.300+0000 7f907b7fe640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0cf850 0x7f907c1434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:13.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.301+0000 7f907affd640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 0x7f907c1429a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f907000d830 tx=0x7f907000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.301+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907000b660 con 0x7f907c0d1380 2024-06-13T11:37:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.301+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9070019070 con 0x7f907c0d1380 2024-06-13T11:37:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.301+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c1466e0 con 0x7f907c0d1380 2024-06-13T11:37:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.301+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907000ba60 con 0x7f907c0d1380 2024-06-13T11:37:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.301+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c0c4230 con 0x7f907c0d1380 2024-06-13T11:37:13.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.302+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f907c04ffb0 con 0x7f907c0d1380 2024-06-13T11:37:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.303+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f907001e460 con 0x7f907c0d1380 2024-06-13T11:37:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.303+0000 7f9063fff640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f906806be60 0x7f906806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.303+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f907008b820 con 0x7f907c0d1380 2024-06-13T11:37:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.303+0000 7f907b7fe640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f906806be60 0x7f906806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.304+0000 7f907b7fe640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f906806be60 0x7f906806e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f906c001660 tx=0x7f906c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.307+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9070059e80 con 0x7f907c0d1380 2024-06-13T11:37:13.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.492+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f907c068870 con 0x7f907c0d1380 2024-06-13T11:37:13.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.494+0000 7f9063fff640 1 -- 172.21.15.43:0/715887995 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f9070059780 con 0x7f907c0d1380 2024-06-13T11:37:13.493 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:13.493 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:13.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f906806be60 msgr2=0x7f906806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f906806be60 0x7f906806e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f906c001660 tx=0x7f906c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 msgr2=0x7f907c1429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 0x7f907c1429a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f907000d830 tx=0x7f907000dcf0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 shutdown_connections 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f906806be60 0x7f906806e320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907c147480 0x7f907c0c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907c0d1380 0x7f907c1429a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 --2- 172.21.15.43:0/715887995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f907c0cf850 0x7f907c1434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 >> 172.21.15.43:0/715887995 conn(0x7f907c070810 msgr2=0x7f907c0d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 shutdown_connections 2024-06-13T11:37:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.496+0000 7f9081fce640 1 -- 172.21.15.43:0/715887995 wait complete. 2024-06-13T11:37:13.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:13.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:37:13.591 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:37:13.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.611+0000 7f4c93ed4640 1 Processor -- start 2024-06-13T11:37:13.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.611+0000 7f4c93ed4640 1 -- start start 2024-06-13T11:37:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c93ed4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 0x7f4c8c072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c93ed4640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c93ed4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4c8c06b8d0 0x7f4c8c161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c93ed4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4c8c0aea80 con 0x7f4c8c147130 2024-06-13T11:37:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c93ed4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4c8c0aded0 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c93ed4640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c0ae150 con 0x7f4c8c073490 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c91c70640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 0x7f4c8c072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c91c70640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 0x7f4c8c072340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36176/0 (socket says 172.21.15.43:36176) 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c91c70640 1 -- 172.21.15.43:0/3397694943 learned_addr learned my addr 172.21.15.43:0/3397694943 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c92471640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.53:3300/0 conn(0x7f4c8c06b8d0 0x7f4c8c161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.612+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3397694943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c9146f640 1 -- 172.21.15.43:0/3397694943 >> v2:172.21.15.53:3300/0 conn(0x7f4c8c06b8d0 msgr2=0x7f4c8c161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.53:3300/0 conn(0x7f4c8c06b8d0 0x7f4c8c161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c9146f640 1 -- 172.21.15.43:0/3397694943 >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 msgr2=0x7f4c8c072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 0x7f4c8c072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c9146f640 1 -- 172.21.15.43:0/3397694943 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c0ae430 con 0x7f4c8c073490 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c92471640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.53:3300/0 conn(0x7f4c8c06b8d0 0x7f4c8c161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.613+0000 7f4c91c70640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 0x7f4c8c072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.614+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3397694943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c06b390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c06db10 tx=0x7f4c8802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95747f84d0f0504b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.614+0000 7f4c90c6e640 1 -- 172.21.15.43:0/3397694943 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88037070 con 0x7f4c8c073490 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.614+0000 7f4c90c6e640 1 -- 172.21.15.43:0/3397694943 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8802ae50 con 0x7f4c8c073490 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.614+0000 7f4c90c6e640 1 -- 172.21.15.43:0/3397694943 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88032660 con 0x7f4c8c073490 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3397694943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 msgr2=0x7f4c8c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3397694943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c06b390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c06db10 tx=0x7f4c8802a100 comp rx=0 tx=0).stop 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3397694943 shutdown_connections 2024-06-13T11:37:13.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.53:3300/0 conn(0x7f4c8c06b8d0 0x7f4c8c161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3397694943 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c06b390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3397694943 >> v2:172.21.15.43:3300/0 conn(0x7f4c8c147130 0x7f4c8c072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3397694943 >> 172.21.15.43:0/3397694943 conn(0x7f4c8c06cb10 msgr2=0x7f4c8c06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3397694943 shutdown_connections 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.615+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3397694943 wait complete. 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.616+0000 7f4c93ed4640 1 Processor -- start 2024-06-13T11:37:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.616+0000 7f4c93ed4640 1 -- start start 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c93ed4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 0x7f4c8c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c93ed4640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c1f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c93ed4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c8c147130 0x7f4c8c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c93ed4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c147510 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c93ed4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c0738f0 con 0x7f4c8c147130 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c93ed4640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c162430 con 0x7f4c8c073490 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 0x7f4c8c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 0x7f4c8c157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36192/0 (socket says 172.21.15.43:36192) 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 -- 172.21.15.43:0/3360293208 learned_addr learned my addr 172.21.15.43:0/3360293208 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c1f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c92471640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c8c147130 0x7f4c8c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 -- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 msgr2=0x7f4c8c1f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c1f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 -- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c8c147130 msgr2=0x7f4c8c140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c8c147130 0x7f4c8c140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 -- 172.21.15.43:0/3360293208 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c1f4e10 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.617+0000 7f4c91c70640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 0x7f4c8c157a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000e9e0 tx=0x7f4c8000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.618+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80017070 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.618+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8000c940 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.618+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8c1f50f0 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.618+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000ccf0 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.618+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8c13eee0 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.619+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8c04ffb0 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.619+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c8001a070 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.620+0000 7f4c7e7fc640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4c7006be60 0x7f4c7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.620+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4c8008b260 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.620+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4c7006be60 0x7f4c7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.621+0000 7f4c9146f640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4c7006be60 0x7f4c7006e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c88034000 tx=0x7f4c8802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.624+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c80059280 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.623 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T11:37:13.623+0000 7f81d4a51640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-13T11:37:13.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.811+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c8c072d60 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.813+0000 7f4c7e7fc640 1 -- 172.21.15.43:0/3360293208 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f4c8005d580 con 0x7f4c8c06b8d0 2024-06-13T11:37:13.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:13.812 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4c7006be60 msgr2=0x7f4c7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4c7006be60 0x7f4c7006e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c88034000 tx=0x7f4c8802e000 comp rx=0 tx=0).stop 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 msgr2=0x7f4c8c157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 0x7f4c8c157a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000e9e0 tx=0x7f4c8000ede0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 shutdown_connections 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4c7006be60 0x7f4c7006e320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c8c147130 0x7f4c8c140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4c8c073490 0x7f4c8c1f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 --2- 172.21.15.43:0/3360293208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c8c06b8d0 0x7f4c8c157a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 >> 172.21.15.43:0/3360293208 conn(0x7f4c8c06cb10 msgr2=0x7f4c8c1613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 shutdown_connections 2024-06-13T11:37:13.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.815+0000 7f4c93ed4640 1 -- 172.21.15.43:0/3360293208 wait complete. 2024-06-13T11:37:13.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:13.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.945+0000 7f2951ae7640 1 Processor -- start 2024-06-13T11:37:13.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.945+0000 7f2951ae7640 1 -- start start 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f2951ae7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f294c0718c0 0x7f294c0d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f2951ae7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f2951ae7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c071ea0 con 0x7f294c144d40 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f2951ae7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f294c072180 con 0x7f294c0718c0 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f2951ae7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f294c072460 con 0x7f294c0d0dd0 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294bfff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f294c144d40 0x7f294c072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:41946/0 (socket says 172.21.15.43:41946) 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294b7fe640 1 -- 172.21.15.43:0/1542974195 learned_addr learned my addr 172.21.15.43:0/1542974195 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:13.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f294c0718c0 0x7f294c0d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294a7fc640 1 -- 172.21.15.43:0/1542974195 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023196994 0 0) 0x7f294c071ea0 con 0x7f294c144d40 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294a7fc640 1 -- 172.21.15.43:0/1542974195 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2934003520 con 0x7f294c144d40 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294bfff640 1 -- 172.21.15.43:0/1542974195 >> v2:172.21.15.53:3300/0 conn(0x7f294c0718c0 msgr2=0x7f294c0d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294bfff640 1 --2- 172.21.15.43:0/1542974195 >> v2:172.21.15.53:3300/0 conn(0x7f294c0718c0 0x7f294c0d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294bfff640 1 -- 172.21.15.43:0/1542974195 >> v1:172.21.15.53:6789/0 conn(0x7f294c144d40 legacy=0x7f294c072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294bfff640 1 -- 172.21.15.43:0/1542974195 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c072740 con 0x7f294c0d0dd0 2024-06-13T11:37:13.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.946+0000 7f294affd640 1 --2- 172.21.15.43:0/1542974195 >> v2:172.21.15.53:3300/0 conn(0x7f294c0718c0 0x7f294c0d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.947+0000 7f294bfff640 1 --2- 172.21.15.43:0/1542974195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c0d1260 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29440097a0 tx=0x7f294402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3ab16b2bc15925a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.947+0000 7f294a7fc640 1 -- 172.21.15.43:0/1542974195 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944037070 con 0x7f294c0d0dd0 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.947+0000 7f294a7fc640 1 -- 172.21.15.43:0/1542974195 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294402ae50 con 0x7f294c0d0dd0 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.947+0000 7f294a7fc640 1 -- 172.21.15.43:0/1542974195 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944032640 con 0x7f294c0d0dd0 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 -- 172.21.15.43:0/1542974195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 msgr2=0x7f294c0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 --2- 172.21.15.43:0/1542974195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c0d1260 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29440097a0 tx=0x7f294402a100 comp rx=0 tx=0).stop 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 -- 172.21.15.43:0/1542974195 shutdown_connections 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 --2- 172.21.15.43:0/1542974195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c0d1260 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 --2- 172.21.15.43:0/1542974195 >> v2:172.21.15.53:3300/0 conn(0x7f294c0718c0 0x7f294c0d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 -- 172.21.15.43:0/1542974195 >> 172.21.15.43:0/1542974195 conn(0x7f294c070810 msgr2=0x7f294c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 -- 172.21.15.43:0/1542974195 shutdown_connections 2024-06-13T11:37:13.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.948+0000 7f2951ae7640 1 -- 172.21.15.43:0/1542974195 wait complete. 2024-06-13T11:37:13.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.949+0000 7f2951ae7640 1 Processor -- start 2024-06-13T11:37:13.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.949+0000 7f2951ae7640 1 -- start start 2024-06-13T11:37:13.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f2951ae7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f294c0718c0 0x7f294c15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f2951ae7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c13a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f2951ae7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 0x7f294c13a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f2951ae7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f294c145120 con 0x7f294c144d40 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f2951ae7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f294c0d05b0 con 0x7f294c0718c0 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f2951ae7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f294c0b2690 con 0x7f294c0d0dd0 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 0x7f294c13a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 0x7f294c13a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36196/0 (socket says 172.21.15.43:36196) 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 -- 172.21.15.43:0/3886246112 learned_addr learned my addr 172.21.15.43:0/3886246112 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294b7fe640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f294c0718c0 0x7f294c15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294affd640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c13a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 -- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 msgr2=0x7f294c13a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c13a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 -- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f294c0718c0 msgr2=0x7f294c15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f294c0718c0 0x7f294c15bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 -- 172.21.15.43:0/3886246112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c15c4d0 con 0x7f294c144d40 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.950+0000 7f294bfff640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 0x7f294c13a9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2944035040 tx=0x7f29440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.951+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944041070 con 0x7f294c144d40 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.951+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294403c460 con 0x7f294c144d40 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.951+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944037040 con 0x7f294c144d40 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.951+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294c13e090 con 0x7f294c144d40 2024-06-13T11:37:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.951+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294c0b20d0 con 0x7f294c144d40 2024-06-13T11:37:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.952+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294c071f10 con 0x7f294c144d40 2024-06-13T11:37:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.952+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f294403a070 con 0x7f294c144d40 2024-06-13T11:37:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.953+0000 7f2933fff640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f293806be60 0x7f293806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.953+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f29440ab1a0 con 0x7f294c144d40 2024-06-13T11:37:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.953+0000 7f294b7fe640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f293806be60 0x7f293806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.954+0000 7f294b7fe640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f293806be60 0x7f293806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f293c007fd0 tx=0x7f293c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:13.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:13.957+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f294c071f10 con 0x7f294c144d40 2024-06-13T11:37:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.176+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f294c04ffb0 con 0x7f294c144d40 2024-06-13T11:37:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.177+0000 7f2933fff640 1 -- 172.21.15.43:0/3886246112 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f294c15c4d0 con 0x7f294c144d40 2024-06-13T11:37:14.176 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:14.176 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:12.203657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:14.177 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 7 2024-06-13T11:37:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f293806be60 msgr2=0x7f293806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f293806be60 0x7f293806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f293c007fd0 tx=0x7f293c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 msgr2=0x7f294c13a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 0x7f294c13a9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2944035040 tx=0x7f29440046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 shutdown_connections 2024-06-13T11:37:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f293806be60 0x7f293806e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f294c144d40 0x7f294c13a9c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f294c0d0dd0 0x7f294c13a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 --2- 172.21.15.43:0/3886246112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f294c0718c0 0x7f294c15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 >> 172.21.15.43:0/3886246112 conn(0x7f294c070810 msgr2=0x7f294c15d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 shutdown_connections 2024-06-13T11:37:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.179+0000 7f2951ae7640 1 -- 172.21.15.43:0/3886246112 wait complete. 2024-06-13T11:37:14.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:14.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.293+0000 7fb03b763640 1 Processor -- start 2024-06-13T11:37:14.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.293+0000 7fb03b763640 1 -- start start 2024-06-13T11:37:14.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb03b763640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb0340d1380 0x7fb034147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb03b763640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0340cffc0 con 0x7fb034147480 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb03b763640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0340d02a0 con 0x7fb0340cf850 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb03b763640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb034071db0 con 0x7fb0340d1380 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb038cfe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb0340d1380 0x7fb034147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb0394ff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb034147480 0x7fb0340d0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45026/0 (socket says 172.21.15.43:45026) 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.294+0000 7fb0394ff640 1 -- 172.21.15.43:0/2976119005 learned_addr learned my addr 172.21.15.43:0/2976119005 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.295+0000 7fb038cfe640 1 -- 172.21.15.43:0/2976119005 >> v1:172.21.15.53:6789/0 conn(0x7fb0340cf850 legacy=0x7fb034072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.295+0000 7fb038cfe640 1 -- 172.21.15.43:0/2976119005 >> v1:172.21.15.43:6789/0 conn(0x7fb034147480 legacy=0x7fb0340d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.295+0000 7fb038cfe640 1 -- 172.21.15.43:0/2976119005 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb034071a40 con 0x7fb0340d1380 2024-06-13T11:37:14.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.295+0000 7fb038cfe640 1 --2- 172.21.15.43:0/2976119005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034147dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0280097a0 tx=0x7fb02802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94c4112755b084a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:14.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.295+0000 7fb033fff640 1 -- 172.21.15.43:0/2976119005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028037070 con 0x7fb0340d1380 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb033fff640 1 -- 172.21.15.43:0/2976119005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb028032440 con 0x7fb0340d1380 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb033fff640 1 -- 172.21.15.43:0/2976119005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028032810 con 0x7fb0340d1380 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 -- 172.21.15.43:0/2976119005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 msgr2=0x7fb034147dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 --2- 172.21.15.43:0/2976119005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034147dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0280097a0 tx=0x7fb02802a230 comp rx=0 tx=0).stop 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 -- 172.21.15.43:0/2976119005 shutdown_connections 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 --2- 172.21.15.43:0/2976119005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034147dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 -- 172.21.15.43:0/2976119005 >> 172.21.15.43:0/2976119005 conn(0x7fb034070810 msgr2=0x7fb034070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 -- 172.21.15.43:0/2976119005 shutdown_connections 2024-06-13T11:37:14.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.296+0000 7fb03b763640 1 -- 172.21.15.43:0/2976119005 wait complete. 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.297+0000 7fb03b763640 1 Processor -- start 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.297+0000 7fb03b763640 1 -- start start 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb03b763640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0340cf850 0x7fb0340ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb03b763640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb03b763640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034147480 0x7fb034145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb03b763640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb034072950 con 0x7fb0340d1380 2024-06-13T11:37:14.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb03b763640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb0340ae340 con 0x7fb0340cf850 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb03b763640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb034072ad0 con 0x7fb034147480 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36218/0 (socket says 172.21.15.43:36218) 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 -- 172.21.15.43:0/2855523768 learned_addr learned my addr 172.21.15.43:0/2855523768 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb0394ff640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0340cf850 0x7fb0340ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 -- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034147480 msgr2=0x7fb034145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034147480 0x7fb034145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 -- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0340cf850 msgr2=0x7fb0340ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.298+0000 7fb038cfe640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0340cf850 0x7fb0340ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb038cfe640 1 -- 172.21.15.43:0/2855523768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb034145930 con 0x7fb0340d1380 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb038cfe640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034144ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098c0 tx=0x7fb0280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028037040 con 0x7fb0340d1380 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb028030770 con 0x7fb0340d1380 2024-06-13T11:37:14.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03414de60 con 0x7fb0340d1380 2024-06-13T11:37:14.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028030b40 con 0x7fb0340d1380 2024-06-13T11:37:14.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.299+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03414e420 con 0x7fb0340d1380 2024-06-13T11:37:14.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.300+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03414e620 con 0x7fb0340d1380 2024-06-13T11:37:14.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.301+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb028044020 con 0x7fb0340d1380 2024-06-13T11:37:14.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.301+0000 7fb031ffb640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb02006be30 0x7fb02006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:14.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.301+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb0280ab680 con 0x7fb0340d1380 2024-06-13T11:37:14.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.302+0000 7fb0394ff640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb02006be30 0x7fb02006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:14.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.302+0000 7fb0394ff640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb02006be30 0x7fb02006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005c00 tx=0x7fb02c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:14.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.306+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb03414e620 con 0x7fb0340d1380 2024-06-13T11:37:14.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.493+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb03404ffb0 con 0x7fb0340d1380 2024-06-13T11:37:14.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.494+0000 7fb031ffb640 1 -- 172.21.15.43:0/2855523768 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fb028032e20 con 0x7fb0340d1380 2024-06-13T11:37:14.493 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:14.494 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:14.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb02006be30 msgr2=0x7fb02006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb02006be30 0x7fb02006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005c00 tx=0x7fb02c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:14.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 msgr2=0x7fb034144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034144ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098c0 tx=0x7fb0280046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 shutdown_connections 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb02006be30 0x7fb02006e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb034147480 0x7fb034145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0340d1380 0x7fb034144ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 --2- 172.21.15.43:0/2855523768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0340cf850 0x7fb0340ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 >> 172.21.15.43:0/2855523768 conn(0x7fb034070810 msgr2=0x7fb0340afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 shutdown_connections 2024-06-13T11:37:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:14.496+0000 7fb03b763640 1 -- 172.21.15.43:0/2855523768 wait complete. 2024-06-13T11:37:14.908 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-13T11:37:07.166526+0000', 'modified': '2024-06-13T11:37:12.203657+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3684318911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3684318911}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3684318911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-06-13T11:37:14.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-13T11:37:14.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-13T11:37:15.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.020+0000 7fced2b63640 1 Processor -- start 2024-06-13T11:37:15.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.020+0000 7fced2b63640 1 -- start start 2024-06-13T11:37:15.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced2b63640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc15c9a0 0x7fcecc072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced2b63640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcecc15cea0 con 0x7fcecc144c20 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced2b63640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcecc15d180 con 0x7fcecc0721b0 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced2b63640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc145000 con 0x7fcecc15c9a0 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced08ff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcecc144c20 0x7fcecc0cc960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45042/0 (socket says 172.21.15.43:45042) 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced08ff640 1 -- 172.21.15.43:0/2982858820 learned_addr learned my addr 172.21.15.43:0/2982858820 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced1100640 1 --2- 172.21.15.43:0/2982858820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc15c9a0 0x7fcecc072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663871734 0 0) 0x7fcecc15cea0 con 0x7fcecc144c20 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcebc003520 con 0x7fcecc144c20 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469702422 0 0) 0x7fcecc15d180 con 0x7fcecc0721b0 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcecc15cea0 con 0x7fcecc0721b0 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced1100640 1 -- 172.21.15.43:0/2982858820 >> v1:172.21.15.53:6789/0 conn(0x7fcecc0721b0 legacy=0x7fcecc15c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced1100640 1 -- 172.21.15.43:0/2982858820 >> v1:172.21.15.43:6789/0 conn(0x7fcecc144c20 legacy=0x7fcecc0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.021+0000 7fced1100640 1 -- 172.21.15.43:0/2982858820 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc15d460 con 0x7fcecc15c9a0 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.022+0000 7fced1100640 1 --2- 172.21.15.43:0/2982858820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc15c9a0 0x7fcecc072640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009dc0 tx=0x7fcec402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef44bd16d6a53537 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.022+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec402ae60 con 0x7fcecc15c9a0 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.022+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec4007740 con 0x7fcecc15c9a0 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.022+0000 7fcecb7fe640 1 -- 172.21.15.43:0/2982858820 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4007af0 con 0x7fcecc15c9a0 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 -- 172.21.15.43:0/2982858820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc15c9a0 msgr2=0x7fcecc072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 --2- 172.21.15.43:0/2982858820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc15c9a0 0x7fcecc072640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009dc0 tx=0x7fcec402a640 comp rx=0 tx=0).stop 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 -- 172.21.15.43:0/2982858820 shutdown_connections 2024-06-13T11:37:15.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 --2- 172.21.15.43:0/2982858820 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc15c9a0 0x7fcecc072640 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 -- 172.21.15.43:0/2982858820 >> 172.21.15.43:0/2982858820 conn(0x7fcecc0b14b0 msgr2=0x7fcecc0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 -- 172.21.15.43:0/2982858820 shutdown_connections 2024-06-13T11:37:15.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.023+0000 7fced2b63640 1 -- 172.21.15.43:0/2982858820 wait complete. 2024-06-13T11:37:15.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.024+0000 7fced2b63640 1 Processor -- start 2024-06-13T11:37:15.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.024+0000 7fced2b63640 1 -- start start 2024-06-13T11:37:15.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced2b63640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc0721b0 0x7fcecc1f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced2b63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 0x7fcecc15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced2b63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc15c9a0 0x7fcecc134a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced2b63640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc15df40 con 0x7fcecc144c20 2024-06-13T11:37:15.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced2b63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc15da20 con 0x7fcecc15c9a0 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced2b63640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc15e0c0 con 0x7fcecc0721b0 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 0x7fcecc15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 0x7fcecc15acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36220/0 (socket says 172.21.15.43:36220) 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 -- 172.21.15.43:0/3133520884 learned_addr learned my addr 172.21.15.43:0/3133520884 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced1100640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc15c9a0 0x7fcecc134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced08ff640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc0721b0 0x7fcecc1f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 -- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc0721b0 msgr2=0x7fcecc1f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc0721b0 0x7fcecc1f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 -- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc15c9a0 msgr2=0x7fcecc134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc15c9a0 0x7fcecc134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 -- 172.21.15.43:0/3133520884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc15b1f0 con 0x7fcecc144c20 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fced1100640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc15c9a0 0x7fcecc134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:15.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.025+0000 7fcecbfff640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 0x7fcecc15acb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c490 tx=0x7fceb800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.026+0000 7fcec97fa640 1 -- 172.21.15.43:0/3133520884 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80052d0 con 0x7fcecc144c20 2024-06-13T11:37:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.026+0000 7fcec97fa640 1 -- 172.21.15.43:0/3133520884 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb8005470 con 0x7fcecc144c20 2024-06-13T11:37:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.026+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc1322b0 con 0x7fcecc144c20 2024-06-13T11:37:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.026+0000 7fcec97fa640 1 -- 172.21.15.43:0/3133520884 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8012870 con 0x7fcecc144c20 2024-06-13T11:37:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.026+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc132870 con 0x7fcecc144c20 2024-06-13T11:37:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.027+0000 7fcec97fa640 1 -- 172.21.15.43:0/3133520884 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fceb8012a10 con 0x7fcecc144c20 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.028+0000 7fcec97fa640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fceb006be30 0x7fceb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.028+0000 7fcec97fa640 1 -- 172.21.15.43:0/3133520884 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fceb808adb0 con 0x7fcecc144c20 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.028+0000 7fced08ff640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fceb006be30 0x7fceb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced08ff640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fceb006be30 0x7fceb006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcec00011e0 tx=0x7fcec0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 Processor -- start 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 -- start start 2024-06-13T11:37:15.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f094f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094c9990 0x562f094cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f09515b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562f09432740 con 0x562f094f9730 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f093d0a80 con 0x562f09515690 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.029+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x562f0942e700 con 0x562f094c9990 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f094f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f094f9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36222/0 (socket says 172.21.15.43:36222) 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 -- 172.21.15.43:0/1872854789 learned_addr learned my addr 172.21.15.43:0/1872854789 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fcecbfff640 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094c9990 0x562f094cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced1100640 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f09515b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 -- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094c9990 msgr2=0x562f094cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094c9990 0x562f094cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 -- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 msgr2=0x562f09515b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f09515b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 -- 172.21.15.43:0/1872854789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f093fbfb0 con 0x562f094f9730 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced1100640 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f09515b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fced08ff640 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f094f9b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcec00058e0 tx=0x7fcec0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cc1f6f39188fa5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fceb67fc640 1 -- 172.21.15.43:0/1872854789 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0005e60 con 0x562f094f9730 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fceb67fc640 1 -- 172.21.15.43:0/1872854789 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec000e7b0 con 0x562f094f9730 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.030+0000 7fceb67fc640 1 -- 172.21.15.43:0/1872854789 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec000eb80 con 0x562f094f9730 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 -- 172.21.15.43:0/1872854789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 msgr2=0x562f094f9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f094f9b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcec00058e0 tx=0x7fcec0011000 comp rx=0 tx=0).stop 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 -- 172.21.15.43:0/1872854789 shutdown_connections 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f09515b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094c9990 0x562f094cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 --2- 172.21.15.43:0/1872854789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f094f9b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 -- 172.21.15.43:0/1872854789 >> 172.21.15.43:0/1872854789 conn(0x562f094cbc00 msgr2=0x562f09514540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 -- 172.21.15.43:0/1872854789 shutdown_connections 2024-06-13T11:37:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 -- 172.21.15.43:0/1872854789 wait complete. 2024-06-13T11:37:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.031+0000 7fced587c740 1 -- start start 2024-06-13T11:37:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 Processor -- start 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f094fc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f094f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094f6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562f094cff00 con 0x562f09515690 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f093bbc30 con 0x562f094f9730 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x562f094cf530 con 0x562f094ef160 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced587c740 10 client.0 _ll_register_callbacks cb 0x562f093ed7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f094f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f094f5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36232/0 (socket says 172.21.15.43:36232) 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fcecbfff640 1 -- 172.21.15.43:0/2147569559 learned_addr learned my addr 172.21.15.43:0/2147569559 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.032+0000 7fced08ff640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f094fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fced1100640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fcecbfff640 1 -- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 msgr2=0x562f094f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fcecbfff640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fcecbfff640 1 -- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 msgr2=0x562f094fc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fcecbfff640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f094fc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fcecbfff640 1 -- 172.21.15.43:0/2147569559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f091462d0 con 0x562f09515690 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fcecbfff640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f094f5e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c460 tx=0x7fceb805d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bbdf68e9a51037 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fceab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fceab7fe640 1 -- 172.21.15.43:0/2147569559 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8057170 con 0x562f09515690 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fceab7fe640 1 -- 172.21.15.43:0/2147569559 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fceb8061500 con 0x562f09515690 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec000e7b0 con 0x562f09515690 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fceab7fe640 1 -- 172.21.15.43:0/2147569559 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fceb8061700 con 0x562f09515690 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fced587c740 10 client.4419 fetch_fsmap learned FSMap version 7 2024-06-13T11:37:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562f092106b0 con 0x562f09515690 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fceab7fe640 1 -- 172.21.15.43:0/2147569559 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec000e7b0 con 0x562f09515690 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fceab7fe640 1 -- 172.21.15.43:0/2147569559 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fceb805f040 con 0x562f09515690 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fced587c740 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.033+0000 7fced587c740 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fced587c740 20 client.4419 populate_metadata read hostname 'smithi043' 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fced587c740 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f095299a0 0x562f09529d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fced587c740 4 client.4419 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 --> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f0943fe70 con 0x562f095299a0 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fced08ff640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f095299a0 0x562f09529d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fced08ff640 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f095299a0 0x562f09529d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425d67e67b2c46cd server_cookie=ba0da09ac12289d7 in_seq=0 out_seq=0 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.034+0000 7fceab7fe640 10 client.4419 ms_handle_connect on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fceab7fe640 1 -- 172.21.15.43:0/2147569559 <== mds.0 v2:172.21.15.53:6834/3684318911 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562f0943fe70 con 0x562f095299a0 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fceab7fe640 10 client.4419 handle_command_reply: tid=0 2024-06-13T11:37:15.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 client.4419 shutdown 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 msgr2=0x562f094f5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f094f5e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c460 tx=0x7fceb805d220 comp rx=0 tx=0).stop 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 shutdown_connections 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f095299a0 0x562f09529d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f094f5e40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fceab7fe640 0 client.4419 ms_handle_reset on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 --2- 172.21.15.43:0/2147569559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f094fc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 >> 172.21.15.43:0/2147569559 conn(0x562f094c9990 msgr2=0x562f094fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 shutdown_connections 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 1 -- 172.21.15.43:0/2147569559 wait complete. 2024-06-13T11:37:15.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.035+0000 7fced587c740 20 client.4419 trim_cache size 0 max 16384 2024-06-13T11:37:15.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.054+0000 7fced587c740 1 Processor -- start 2024-06-13T11:37:15.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.054+0000 7fced587c740 1 -- start start 2024-06-13T11:37:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced587c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f0953cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f0953d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced587c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc1fd760 con 0x562f094f9730 2024-06-13T11:37:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc1fc740 con 0x562f09515690 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc0aea30 con 0x562f094ef160 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f0953cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f0953cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36246/0 (socket says 172.21.15.43:36246) 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 -- 172.21.15.43:0/114310077 learned_addr learned my addr 172.21.15.43:0/114310077 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced1100640 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f0953d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced08ff640 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 -- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 msgr2=0x562f094fa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094fa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 -- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 msgr2=0x562f0953d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f0953d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fcecbfff640 1 -- 172.21.15.43:0/114310077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f09512b70 con 0x562f094f9730 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.055+0000 7fced08ff640 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094fa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fcecbfff640 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f0953cba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fceb8007ec0 tx=0x7fceb8061b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6019be8873f25621 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fceb5ffb640 1 -- 172.21.15.43:0/114310077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8057170 con 0x562f094f9730 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fceb5ffb640 1 -- 172.21.15.43:0/114310077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb8087070 con 0x562f094f9730 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fceb5ffb640 1 -- 172.21.15.43:0/114310077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8061be0 con 0x562f094f9730 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 -- 172.21.15.43:0/114310077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 msgr2=0x562f0953cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f0953cba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fceb8007ec0 tx=0x7fceb8061b10 comp rx=0 tx=0).stop 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 -- 172.21.15.43:0/114310077 shutdown_connections 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f09515690 0x562f0953d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f094f9730 0x562f0953cba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 --2- 172.21.15.43:0/114310077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094fa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 -- 172.21.15.43:0/114310077 >> 172.21.15.43:0/114310077 conn(0x562f094c9990 msgr2=0x562f094fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 -- 172.21.15.43:0/114310077 shutdown_connections 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.056+0000 7fced587c740 1 -- 172.21.15.43:0/114310077 wait complete. 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.057+0000 7fced587c740 1 -- start start 2024-06-13T11:37:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.057+0000 7fced587c740 1 Processor -- start 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f0950c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f0950cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562f0950bbd0 con 0x562f09515690 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc1fc1c0 con 0x562f094f9730 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x562f0950c420 con 0x562f094ef160 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced587c740 10 client.0 _ll_register_callbacks cb 0x7fceb80594d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f0950cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f0950cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36252/0 (socket says 172.21.15.43:36252) 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 -- 172.21.15.43:0/1682977452 learned_addr learned my addr 172.21.15.43:0/1682977452 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fcecbfff640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f0950c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced08ff640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 -- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 msgr2=0x562f094cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 -- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 msgr2=0x562f0950c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f0950c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 -- 172.21.15.43:0/1682977452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f094cdec0 con 0x562f09515690 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fced1100640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f0950cb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c090 tx=0x7fcec4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54bfdd5cadfaf9c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fceab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.058+0000 7fceab7fe640 1 -- 172.21.15.43:0/1682977452 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4009450 con 0x562f09515690 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fceab7fe640 1 -- 172.21.15.43:0/1682977452 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcec4007de0 con 0x562f09515690 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb8087070 con 0x562f09515690 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fceab7fe640 1 -- 172.21.15.43:0/1682977452 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fcec4054050 con 0x562f09515690 2024-06-13T11:37:15.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 10 client.4425 fetch_fsmap learned FSMap version 7 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562f094ce150 con 0x562f09515690 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fceab7fe640 1 -- 172.21.15.43:0/1682977452 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb8087070 con 0x562f09515690 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fceab7fe640 1 -- 172.21.15.43:0/1682977452 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fcec4057020 con 0x562f09515690 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 20 client.4425 populate_metadata read hostname 'smithi043' 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f0950a930 0x562f0950ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 4 client.4425 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 --> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] -- command(tid 0: {"prefix": "status"}) -- 0x562f0943a1c0 con 0x562f0950a930 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.059+0000 7fced08ff640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f0950a930 0x562f0950ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced08ff640 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f0950a930 0x562f0950ad10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70272dda782ec9 server_cookie=1bb62df7bc2f8fc4 in_seq=0 out_seq=0 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fceab7fe640 10 client.4425 ms_handle_connect on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fceab7fe640 1 -- 172.21.15.43:0/1682977452 <== mds.0 v2:172.21.15.53:6834/3684318911 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x562f0943a1c0 con 0x562f0950a930 2024-06-13T11:37:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fceab7fe640 10 client.4425 handle_command_reply: tid=0 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 client.4425 shutdown 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 msgr2=0x562f0950cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f0950cb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcec400c090 tx=0x7fcec4004ab0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 shutdown_connections 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x562f0950a930 0x562f0950ad10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562f09515690 0x562f0950cb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fceab7fe640 0 client.4425 ms_handle_reset on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f094f9730 0x562f0950c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 --2- 172.21.15.43:0/1682977452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x562f094ef160 0x562f094cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 >> 172.21.15.43:0/1682977452 conn(0x562f094c9990 msgr2=0x562f094c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 shutdown_connections 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 1 -- 172.21.15.43:0/1682977452 wait complete. 2024-06-13T11:37:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.060+0000 7fced587c740 20 client.4425 trim_cache size 0 max 16384 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5", 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4296, 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 7.2627616919999998, 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 7, 2024-06-13T11:37:15.066 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 25, 2024-06-13T11:37:15.067 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 24, 2024-06-13T11:37:15.067 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 13.430161141999999 2024-06-13T11:37:15.067 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-06-13T11:37:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fceb006be30 msgr2=0x7fceb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fceb006be30 0x7fceb006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcec00011e0 tx=0x7fcec0009040 comp rx=0 tx=0).stop 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 msgr2=0x7fcecc15acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 0x7fcecc15acb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c490 tx=0x7fceb800c950 comp rx=0 tx=0).stop 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 shutdown_connections 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fceb006be30 0x7fceb006e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc15c9a0 0x7fcecc134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcecc144c20 0x7fcecc15acb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 --2- 172.21.15.43:0/3133520884 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fcecc0721b0 0x7fcecc1f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 >> 172.21.15.43:0/3133520884 conn(0x7fcecc0b14b0 msgr2=0x7fcecc0cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 shutdown_connections 2024-06-13T11:37:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.061+0000 7fced2b63640 1 -- 172.21.15.43:0/3133520884 wait complete. 2024-06-13T11:37:15.071 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:37:15.071 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:15.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-13T11:37:15.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.175+0000 7f8a8ba8c640 1 Processor -- start 2024-06-13T11:37:15.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.175+0000 7f8a8ba8c640 1 -- start start 2024-06-13T11:37:15.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a8ba8c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8a84155010 0x7f8a8415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a8ba8c640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a840711f0 con 0x7f8a841553f0 2024-06-13T11:37:15.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a8ba8c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a840723a0 con 0x7f8a8406d840 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a8ba8c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8a84072f60 con 0x7f8a84155010 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a89828640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8a84155010 0x7f8a8415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a8a029640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8a841553f0 0x7f8a8406e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45046/0 (socket says 172.21.15.43:45046) 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a8a029640 1 -- 172.21.15.43:0/3592158712 learned_addr learned my addr 172.21.15.43:0/3592158712 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a89828640 1 -- 172.21.15.43:0/3592158712 >> v1:172.21.15.53:6789/0 conn(0x7f8a8406d840 legacy=0x7f8a84071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a89828640 1 -- 172.21.15.43:0/3592158712 >> v1:172.21.15.43:6789/0 conn(0x7f8a841553f0 legacy=0x7f8a8406e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a89828640 1 -- 172.21.15.43:0/3592158712 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a84071490 con 0x7f8a84155010 2024-06-13T11:37:15.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.176+0000 7f8a88826640 1 -- 172.21.15.43:0/3592158712 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633503261 0 0) 0x7f8a840711f0 con 0x7f8a841553f0 2024-06-13T11:37:15.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.177+0000 7f8a89828640 1 --2- 172.21.15.43:0/3592158712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8415f230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354b3ba0674317dc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.177+0000 7f8a88826640 1 -- 172.21.15.43:0/3592158712 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80037070 con 0x7f8a84155010 2024-06-13T11:37:15.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.177+0000 7f8a88826640 1 -- 172.21.15.43:0/3592158712 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80032440 con 0x7f8a84155010 2024-06-13T11:37:15.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.177+0000 7f8a88826640 1 -- 172.21.15.43:0/3592158712 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80032810 con 0x7f8a84155010 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/3592158712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 msgr2=0x7f8a8415f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/3592158712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8415f230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a8002a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/3592158712 shutdown_connections 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/3592158712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8415f230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/3592158712 >> 172.21.15.43:0/3592158712 conn(0x7f8a840b21f0 msgr2=0x7f8a840b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/3592158712 shutdown_connections 2024-06-13T11:37:15.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.178+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/3592158712 wait complete. 2024-06-13T11:37:15.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.179+0000 7f8a8ba8c640 1 Processor -- start 2024-06-13T11:37:15.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.179+0000 7f8a8ba8c640 1 -- start start 2024-06-13T11:37:15.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8ba8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a8406d840 0x7f8a8415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8ba8c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8ba8c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a841553f0 0x7f8a841425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8ba8c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84072c10 con 0x7f8a84155010 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8ba8c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84073240 con 0x7f8a8406d840 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8ba8c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8406e960 con 0x7f8a841553f0 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8413f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36274/0 (socket says 172.21.15.43:36274) 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 -- 172.21.15.43:0/1909524658 learned_addr learned my addr 172.21.15.43:0/1909524658 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89828640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a8406d840 0x7f8a8415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a8a029640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a841553f0 0x7f8a841425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 -- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a841553f0 msgr2=0x7f8a841425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a841553f0 0x7f8a841425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 -- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a8406d840 msgr2=0x7f8a8415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a8406d840 0x7f8a8415ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 -- 172.21.15.43:0/1909524658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a84142b20 con 0x7f8a84155010 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89828640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a8406d840 0x7f8a8415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a89027640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8413f3b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c400 tx=0x7f8a7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74017070 con 0x7f8a84155010 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.180+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740052d0 con 0x7f8a84155010 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.181+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74003830 con 0x7f8a84155010 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.181+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a840aee70 con 0x7f8a84155010 2024-06-13T11:37:15.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.181+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8413fce0 con 0x7f8a84155010 2024-06-13T11:37:15.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.182+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a840af350 con 0x7f8a84155010 2024-06-13T11:37:15.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.182+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a7401a070 con 0x7f8a84155010 2024-06-13T11:37:15.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.182+0000 7f8a7a7fc640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a6806be30 0x7f8a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:15.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.183+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a7408a430 con 0x7f8a84155010 2024-06-13T11:37:15.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.183+0000 7f8a89828640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a6806be30 0x7f8a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:15.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.183+0000 7f8a89828640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a6806be30 0x7f8a6806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a80034000 tx=0x7f8a8002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:15.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.187+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a84142b20 con 0x7f8a84155010 2024-06-13T11:37:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.415+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8a8404ffb0 con 0x7f8a84155010 2024-06-13T11:37:15.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.416+0000 7f8a7a7fc640 1 -- 172.21.15.43:0/1909524658 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f8a74058b30 con 0x7f8a84155010 2024-06-13T11:37:15.415 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:37:15.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a6806be30 msgr2=0x7f8a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a6806be30 0x7f8a6806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a80034000 tx=0x7f8a8002e000 comp rx=0 tx=0).stop 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 msgr2=0x7f8a8413f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8413f3b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c400 tx=0x7f8a7400c8c0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 shutdown_connections 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a6806be30 0x7f8a6806e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a841553f0 0x7f8a841425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a84155010 0x7f8a8413f3b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 --2- 172.21.15.43:0/1909524658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a8406d840 0x7f8a8415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 >> 172.21.15.43:0/1909524658 conn(0x7f8a840b21f0 msgr2=0x7f8a840b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 shutdown_connections 2024-06-13T11:37:15.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15.418+0000 7f8a8ba8c640 1 -- 172.21.15.43:0/1909524658 wait complete. 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:37:15.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:37:15.429 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-13T11:37:15.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:15.429 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:15.445 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42722sec preferred_lft 42722sec 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:15.446 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-06-13T11:37:15.447 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T11:37:15.447 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:15.447 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:15.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-06-13T11:37:15.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-06-13T11:37:15.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-06-13T11:37:15.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T11:37:15.448 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:15.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:15.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:15.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:15.668 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:37:15.695 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-06-13T11:37:15.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:15.696 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-06-13T11:37:15.768 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-06-13T11:37:15.768 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:37:15.768 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:37:15.768 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:37:15.768 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:37:15.769 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:15.769 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:15.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:37:15.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:37:15.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:37:15.769 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:15.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:16.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:16.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:16.085 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-06-13T11:37:16.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:16.102 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-06-13T11:37:16.158 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:16.159 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:16.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:37:16.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-13T11:37:16.159 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:16.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:16.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:16.280 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-13T11:37:16.280 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:16.280 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:16.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-13T11:37:16.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T11:37:16.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-13T11:37:16.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-13T11:37:16.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-13T11:37:16.281 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:16.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:16.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:16.432 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:16.432 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:16.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-06-13T11:37:16.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T11:37:16.433 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:16.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:16.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:16.512 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-13T11:37:16.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:16.512 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:16.527 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-13T11:37:16.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:16.528 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:16.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-06-13T11:37:16.649 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T11:37:16.705 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-06-13T11:37:16.705 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:37:16.706 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-06-13T11:37:16.707 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-06-13T11:37:16.708 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-06-13T11:37:16.708 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:37:16.708 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:37:16.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:16.708 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-06-13T11:37:16.761 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-13T11:37:16.761 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-13T11:37:16.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo modprobe fuse 2024-06-13T11:37:16.828 DEBUG:teuthology.orchestra.run.smithi043:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T11:37:16.884 INFO:teuthology.orchestra.run.smithi043.stdout:/proc 2024-06-13T11:37:16.884 INFO:teuthology.orchestra.run.smithi043.stdout:/sys 2024-06-13T11:37:16.884 INFO:teuthology.orchestra.run.smithi043.stdout:/dev 2024-06-13T11:37:16.884 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/security 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/shm 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/pts 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/run 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/cgroup 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/pstore 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/bpf 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/ 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/selinux 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/mqueue 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/dev/hugepages 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/debug 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/tracing 2024-06-13T11:37:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/fs/fuse/connections 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/sys/kernel/config 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/run/user/1000 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-0 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-1 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-2 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/var/lib/ceph/osd/ceph-3 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:37:16.886 INFO:teuthology.orchestra.run.smithi043.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:37:16.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:16.887 DEBUG:teuthology.orchestra.run.smithi043:> ls /sys/fs/fuse/connections 2024-06-13T11:37:16.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:2024-06-13T11:37:16.904+0000 7f4871f1c480 -1 init, newargv = 0x55c37b6b9bd0 newargc=15 2024-06-13T11:37:16.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[44348]: starting ceph client 2024-06-13T11:37:16.910 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[44348]: starting fuse 2024-06-13T11:37:16.920 INFO:teuthology.orchestra.run.smithi043.stdout:42 2024-06-13T11:37:16.920 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo stdin-killer -- python3 -c ' 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> import glob 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> import re 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> import os 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> import subprocess 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> def _find_admin_socket(client_name): 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> files = glob.glob(asok_path) 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-13T11:37:16.921 DEBUG:teuthology.orchestra.run.smithi043:> 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> # Given a non-glob path, it better be there 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> if "*" not in asok_path: 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> assert(len(files) == 1) 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> return files[0] 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> for f in files: 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> contents = proc_f.read() 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> if mountpoint in contents: 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> return f 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-13T11:37:16.922 DEBUG:teuthology.orchestra.run.smithi043:> 2024-06-13T11:37:16.923 DEBUG:teuthology.orchestra.run.smithi043:> print(_find_admin_socket("client.admin")) 2024-06-13T11:37:16.923 DEBUG:teuthology.orchestra.run.smithi043:> ' 2024-06-13T11:37:17.042 INFO:teuthology.orchestra.run.smithi043.stdout:/var/run/ceph/ceph-client.admin.44348.asok 2024-06-13T11:37:17.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:17.053 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44348.asok 2024-06-13T11:37:17.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:17.053 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44348.asok status 2024-06-13T11:37:17.192 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-06-13T11:37:17.192 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": { 2024-06-13T11:37:17.192 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-13T11:37:17.192 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "entity_id": "admin", 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": "smithi043", 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "pid": "44348", 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "root": "/" 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_count": 0, 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "dentry_pinned_count": 0, 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4440, 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "inst": { 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "name": { 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "client", 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: "num": 4440 2024-06-13T11:37:17.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1730977952 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": { 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "192.168.0.1:0", 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1730977952 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "inst_str": "client.4440 192.168.0.1:0/1730977952", 2024-06-13T11:37:17.194 INFO:teuthology.orchestra.run.smithi043.stdout: "addr_str": "192.168.0.1:0/1730977952", 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout: "inode_count": 1, 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_epoch": 7, 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch": 25, 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_epoch_barrier": 0, 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklisted": false, 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs" 2024-06-13T11:37:17.195 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-06-13T11:37:17.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:17.201 DEBUG:teuthology.orchestra.run.smithi043:> stat --file-system '--printf=%T 2024-06-13T11:37:17.201 DEBUG:teuthology.orchestra.run.smithi043:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:17.216 INFO:teuthology.orchestra.run.smithi043.stdout:fuseblk 2024-06-13T11:37:17.217 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:17.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:17.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:17.283 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-13T11:37:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:17.400 INFO:teuthology.orchestra.run.smithi043.stdout:# file: . 2024-06-13T11:37:17.400 INFO:teuthology.orchestra.run.smithi043.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-13T11:37:17.400 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:17.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:17.406 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:17.406 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:17.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T11:37:17.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.568+0000 7ff7883d5640 1 Processor -- start 2024-06-13T11:37:17.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.568+0000 7ff7883d5640 1 -- start start 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff7883d5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff780144c20 0x7ff7800cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff7883d5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7800721b0 0x7ff780072610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff7883d5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7800ccea0 con 0x7ff78015c290 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff7883d5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff780072b50 con 0x7ff7800721b0 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff7883d5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff780145000 con 0x7ff780144c20 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff785970640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7800721b0 0x7ff780072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff786972640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff78015c290 0x7ff78015c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45048/0 (socket says 172.21.15.43:45048) 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff786972640 1 -- 172.21.15.43:0/1685744211 learned_addr learned my addr 172.21.15.43:0/1685744211 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff786171640 1 --2- 172.21.15.43:0/1685744211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff780144c20 0x7ff7800cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff785970640 1 -- 172.21.15.43:0/1685744211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff780144c20 msgr2=0x7ff7800cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff785970640 1 --2- 172.21.15.43:0/1685744211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff780144c20 0x7ff7800cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff785970640 1 -- 172.21.15.43:0/1685744211 >> v1:172.21.15.43:6789/0 conn(0x7ff78015c290 legacy=0x7ff78015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff785970640 1 -- 172.21.15.43:0/1685744211 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78015cea0 con 0x7ff7800721b0 2024-06-13T11:37:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.569+0000 7ff78516f640 1 -- 172.21.15.43:0/1685744211 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711860799 0 0) 0x7ff7800ccea0 con 0x7ff78015c290 2024-06-13T11:37:17.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.570+0000 7ff785970640 1 --2- 172.21.15.43:0/1685744211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff780072610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff77000ba40 tx=0x7ff77002c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1defa9924b41294 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:17.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.570+0000 7ff78516f640 1 -- 172.21.15.43:0/1685744211 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770031710 con 0x7ff7800721b0 2024-06-13T11:37:17.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.570+0000 7ff78516f640 1 -- 172.21.15.43:0/1685744211 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7700318b0 con 0x7ff7800721b0 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.570+0000 7ff78516f640 1 -- 172.21.15.43:0/1685744211 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770031c80 con 0x7ff7800721b0 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 -- 172.21.15.43:0/1685744211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 msgr2=0x7ff780072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 --2- 172.21.15.43:0/1685744211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff780072610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff77000ba40 tx=0x7ff77002c7b0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 -- 172.21.15.43:0/1685744211 shutdown_connections 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 --2- 172.21.15.43:0/1685744211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff780072610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 --2- 172.21.15.43:0/1685744211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff780144c20 0x7ff7800cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 -- 172.21.15.43:0/1685744211 >> 172.21.15.43:0/1685744211 conn(0x7ff7800b14b0 msgr2=0x7ff7800b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 -- 172.21.15.43:0/1685744211 shutdown_connections 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.571+0000 7ff7883d5640 1 -- 172.21.15.43:0/1685744211 wait complete. 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.572+0000 7ff7883d5640 1 Processor -- start 2024-06-13T11:37:17.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.572+0000 7ff7883d5640 1 -- start start 2024-06-13T11:37:17.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff7883d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff7801f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff7883d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff780144c20 0x7ff780139360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff7883d5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff78015c290 0x7ff7801398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff7883d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff78015d740 con 0x7ff7800721b0 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff7883d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff78015d460 con 0x7ff780144c20 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff7883d5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff78015da20 con 0x7ff78015c290 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff7801f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff7801f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36294/0 (socket says 172.21.15.43:36294) 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 -- 172.21.15.43:0/911072324 learned_addr learned my addr 172.21.15.43:0/911072324 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 -- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff78015c290 msgr2=0x7ff7801398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff78015c290 0x7ff7801398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 -- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff780144c20 msgr2=0x7ff780139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff780144c20 0x7ff780139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.573+0000 7ff786171640 1 -- 172.21.15.43:0/911072324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7800b0b40 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.574+0000 7ff786171640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff7801f5090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e9e0 tx=0x7ff77c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.574+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c017070 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.574+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c00c9d0 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.574+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00cdc0 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.574+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7801f55d0 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.574+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff780137770 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.575+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78004ffb0 con 0x7ff7800721b0 2024-06-13T11:37:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.575+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff77c01a070 con 0x7ff7800721b0 2024-06-13T11:37:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.576+0000 7ff776ffd640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff76406be30 0x7ff76406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.576+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff77c08b270 con 0x7ff7800721b0 2024-06-13T11:37:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.576+0000 7ff785970640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff76406be30 0x7ff76406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.577+0000 7ff785970640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff76406be30 0x7ff76406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff780072d70 tx=0x7ff770030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.581+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff77c0598e0 con 0x7ff7800721b0 2024-06-13T11:37:17.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.779+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff780068610 con 0x7ff7800721b0 2024-06-13T11:37:17.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.780+0000 7ff776ffd640 1 -- 172.21.15.43:0/911072324 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff77c0591e0 con 0x7ff7800721b0 2024-06-13T11:37:17.779 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T11:37:17.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff76406be30 msgr2=0x7ff76406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff76406be30 0x7ff76406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff780072d70 tx=0x7ff770030000 comp rx=0 tx=0).stop 2024-06-13T11:37:17.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 msgr2=0x7ff7801f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff7801f5090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e9e0 tx=0x7ff77c00eea0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 shutdown_connections 2024-06-13T11:37:17.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff76406be30 0x7ff76406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff78015c290 0x7ff7801398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff780144c20 0x7ff780139360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 --2- 172.21.15.43:0/911072324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7800721b0 0x7ff7801f5090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 >> 172.21.15.43:0/911072324 conn(0x7ff7800b14b0 msgr2=0x7ff7801419c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:17.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 shutdown_connections 2024-06-13T11:37:17.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.782+0000 7ff7883d5640 1 -- 172.21.15.43:0/911072324 wait complete. 2024-06-13T11:37:17.792 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:17.792 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:17.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T11:37:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.953+0000 7f30cdb9e640 1 Processor -- start 2024-06-13T11:37:17.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.953+0000 7f30cdb9e640 1 -- start start 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30cdb9e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f30c8158680 0x7f30c8071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30cdb9e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30c8158a60 0x7f30c8070a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30cdb9e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30cdb9e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f30c8072230 con 0x7f30c8158a60 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30cdb9e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f30c815fbd0 con 0x7f30c8158680 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30cdb9e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f30c815feb0 con 0x7f30c8071cb0 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30c7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30c8158a60 0x7f30c8070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30c7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30c8158a60 0x7f30c8070a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36302/0 (socket says 172.21.15.43:36302) 2024-06-13T11:37:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.954+0000 7f30c7fff640 1 -- 172.21.15.43:0/3323630386 learned_addr learned my addr 172.21.15.43:0/3323630386 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30cd39d640 1 --2- 172.21.15.43:0/3323630386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30ccb9c640 1 --2- 172.21.15.43:0/3323630386 >> v2:172.21.15.53:3300/0 conn(0x7f30c8158680 0x7f30c8071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30c7fff640 1 -- 172.21.15.43:0/3323630386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 msgr2=0x7f30c8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30c7fff640 1 --2- 172.21.15.43:0/3323630386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30c7fff640 1 -- 172.21.15.43:0/3323630386 >> v2:172.21.15.53:3300/0 conn(0x7f30c8158680 msgr2=0x7f30c8071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30c7fff640 1 --2- 172.21.15.43:0/3323630386 >> v2:172.21.15.53:3300/0 conn(0x7f30c8158680 0x7f30c8071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30c7fff640 1 -- 172.21.15.43:0/3323630386 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c8160190 con 0x7f30c8158a60 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.955+0000 7f30ccb9c640 1 --2- 172.21.15.43:0/3323630386 >> v2:172.21.15.53:3300/0 conn(0x7f30c8158680 0x7f30c8071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30c7fff640 1 --2- 172.21.15.43:0/3323630386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8070a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30c80b3280 tx=0x7f30b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfff5b83aba7d24a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30c77fe640 1 -- 172.21.15.43:0/3323630386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8036070 con 0x7f30c8158a60 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30c77fe640 1 -- 172.21.15.43:0/3323630386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8031600 con 0x7f30c8158a60 2024-06-13T11:37:17.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30c77fe640 1 -- 172.21.15.43:0/3323630386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b80319d0 con 0x7f30c8158a60 2024-06-13T11:37:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3323630386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 msgr2=0x7f30c8070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3323630386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8070a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f30c80b3280 tx=0x7f30b802a6a0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3323630386 shutdown_connections 2024-06-13T11:37:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3323630386 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3323630386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8070a60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3323630386 >> v2:172.21.15.53:3300/0 conn(0x7f30c8158680 0x7f30c8071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3323630386 >> 172.21.15.43:0/3323630386 conn(0x7f30c80b2390 msgr2=0x7f30c80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3323630386 shutdown_connections 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.956+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3323630386 wait complete. 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.958+0000 7f30cdb9e640 1 Processor -- start 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.958+0000 7f30cdb9e640 1 -- start start 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30c8158680 0x7f30c81525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8161f70 con 0x7f30c8158a60 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30c8161df0 con 0x7f30c8158680 2024-06-13T11:37:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f30c81620f0 con 0x7f30c8071cb0 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36312/0 (socket says 172.21.15.43:36312) 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 -- 172.21.15.43:0/3395273661 learned_addr learned my addr 172.21.15.43:0/3395273661 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30c7fff640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30c8158680 0x7f30c81525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30ccb9c640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 -- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 msgr2=0x7f30c8154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 -- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30c8158680 msgr2=0x7f30c81525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30c8158680 0x7f30c81525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 -- 172.21.15.43:0/3395273661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c8151f30 con 0x7f30c8158a60 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cd39d640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8144580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30b000d800 tx=0x7f30b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:17.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0018020 con 0x7f30c8158a60 2024-06-13T11:37:17.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b00096c0 con 0x7f30c8158a60 2024-06-13T11:37:17.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c81e9f70 con 0x7f30c8158a60 2024-06-13T11:37:17.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0009a90 con 0x7f30c8158a60 2024-06-13T11:37:17.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.959+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c81ea530 con 0x7f30c8158a60 2024-06-13T11:37:17.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.960+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c80cda30 con 0x7f30c8158a60 2024-06-13T11:37:17.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.961+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30b001b020 con 0x7f30c8158a60 2024-06-13T11:37:17.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.961+0000 7f30c57fa640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f30a806be60 0x7f30a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:17.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.961+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f30b008b340 con 0x7f30c8158a60 2024-06-13T11:37:17.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.962+0000 7f30ccb9c640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f30a806be60 0x7f30a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:17.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.962+0000 7f30ccb9c640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f30a806be60 0x7f30a806e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006fd0 tx=0x7f30c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:17.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:17.966+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f30b0022030 con 0x7f30c8158a60 2024-06-13T11:37:18.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.161+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30c806b420 con 0x7f30c8158a60 2024-06-13T11:37:18.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.162+0000 7f30c57fa640 1 -- 172.21.15.43:0/3395273661 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f30c8151f30 con 0x7f30c8158a60 2024-06-13T11:37:18.161 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T11:37:18.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f30a806be60 msgr2=0x7f30a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f30a806be60 0x7f30a806e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006fd0 tx=0x7f30c0008040 comp rx=0 tx=0).stop 2024-06-13T11:37:18.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 msgr2=0x7f30c8144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8144580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30b000d800 tx=0x7f30b000dcc0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 shutdown_connections 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f30a806be60 0x7f30a806e320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30c8158a60 0x7f30c8144580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30c8158680 0x7f30c81525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 --2- 172.21.15.43:0/3395273661 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30c8071cb0 0x7f30c8154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 >> 172.21.15.43:0/3395273661 conn(0x7f30c80b2390 msgr2=0x7f30c80b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 shutdown_connections 2024-06-13T11:37:18.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.164+0000 7f30cdb9e640 1 -- 172.21.15.43:0/3395273661 wait complete. 2024-06-13T11:37:18.174 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi043.front.sepia.ceph.com... 2024-06-13T11:37:18.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:18.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:37:18.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi043.stderr:ceph-fuse[44348]: fuse finished with error 0 and tester_r 0 2024-06-13T11:37:18.200 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T11:37:18.292 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:37:18.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:18.292 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-13T11:37:18.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:18.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.509+0000 7f38163a9640 1 Processor -- start 2024-06-13T11:37:18.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.509+0000 7f38163a9640 1 -- start start 2024-06-13T11:37:18.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.509+0000 7f38163a9640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38100d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f38163a9640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f38100abe00 0x7f38100ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f38163a9640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38100aa5d0 con 0x7f3810155420 2024-06-13T11:37:18.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f38163a9640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f38100d3410 con 0x7f38100abe00 2024-06-13T11:37:18.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f38163a9640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f38100aeb90 con 0x7f38100d2a90 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f38100abe00 0x7f38100ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f38100abe00 0x7f38100ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36316/0 (socket says 172.21.15.43:36316) 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 -- 172.21.15.43:0/4027006938 learned_addr learned my addr 172.21.15.43:0/4027006938 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f380f7fe640 1 --2- 172.21.15.43:0/4027006938 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38100d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 -- 172.21.15.43:0/4027006938 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 msgr2=0x7f38100d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 --2- 172.21.15.43:0/4027006938 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38100d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 -- 172.21.15.43:0/4027006938 >> v1:172.21.15.43:6789/0 conn(0x7f3810155420 legacy=0x7f38100ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f380effd640 1 -- 172.21.15.43:0/4027006938 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233444091 0 0) 0x7f38100aa5d0 con 0x7f3810155420 2024-06-13T11:37:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.510+0000 7f3814946640 1 -- 172.21.15.43:0/4027006938 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3810155800 con 0x7f38100abe00 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f3814946640 1 --2- 172.21.15.43:0/4027006938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38100abe00 0x7f38100ac240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3808009e50 tx=0x7f380802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362d2ef6c818b345 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f380effd640 1 -- 172.21.15.43:0/4027006938 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808036070 con 0x7f38100abe00 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f380effd640 1 -- 172.21.15.43:0/4027006938 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808031600 con 0x7f38100abe00 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f380effd640 1 -- 172.21.15.43:0/4027006938 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38080319d0 con 0x7f38100abe00 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f38163a9640 1 -- 172.21.15.43:0/4027006938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38100abe00 msgr2=0x7f38100ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f38163a9640 1 --2- 172.21.15.43:0/4027006938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38100abe00 0x7f38100ac240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3808009e50 tx=0x7f380802a710 comp rx=0 tx=0).stop 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f38163a9640 1 -- 172.21.15.43:0/4027006938 shutdown_connections 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f38163a9640 1 --2- 172.21.15.43:0/4027006938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38100abe00 0x7f38100ac240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f38163a9640 1 --2- 172.21.15.43:0/4027006938 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38100d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.511+0000 7f38163a9640 1 -- 172.21.15.43:0/4027006938 >> 172.21.15.43:0/4027006938 conn(0x7f3810067640 msgr2=0x7f38100d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:18.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.512+0000 7f38163a9640 1 -- 172.21.15.43:0/4027006938 shutdown_connections 2024-06-13T11:37:18.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.512+0000 7f38163a9640 1 -- 172.21.15.43:0/4027006938 wait complete. 2024-06-13T11:37:18.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.513+0000 7f38163a9640 1 Processor -- start 2024-06-13T11:37:18.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.513+0000 7f38163a9640 1 -- start start 2024-06-13T11:37:18.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f38163a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38100abe00 0x7f3810147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f38163a9640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38101f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f38163a9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 0x7f381015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f38163a9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38100aae30 con 0x7f3810155420 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f38163a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38100aab50 con 0x7f38100abe00 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f38163a9640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f38100ab110 con 0x7f38100d2a90 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 0x7f381015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 0x7f381015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36328/0 (socket says 172.21.15.43:36328) 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 -- 172.21.15.43:0/3392781379 learned_addr learned my addr 172.21.15.43:0/3392781379 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f380ffff640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38100abe00 0x7f3810147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f380f7fe640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38101f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 -- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 msgr2=0x7f38101f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38101f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 -- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38100abe00 msgr2=0x7f3810147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38100abe00 0x7f3810147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 -- 172.21.15.43:0/3392781379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3810162350 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f380ffff640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38100abe00 0x7f3810147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f380f7fe640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38101f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.514+0000 7f3814946640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 0x7f381015b320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3808009e50 tx=0x7f3808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.515+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808036050 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.515+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808042070 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.515+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38101612b0 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.515+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808009510 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.515+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3810161870 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.516+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381004ffb0 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.516+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3808007bd0 con 0x7f3810155420 2024-06-13T11:37:18.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.516+0000 7f380cff9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f37fc06be30 0x7f37fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.517+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f38080abfb0 con 0x7f3810155420 2024-06-13T11:37:18.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.517+0000 7f380ffff640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f37fc06be30 0x7f37fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.517+0000 7f380ffff640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f37fc06be30 0x7f37fc06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3800000f60 tx=0x7f3800009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:18.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.521+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f380807a6b0 con 0x7f3810155420 2024-06-13T11:37:18.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.708+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38100ab920 con 0x7f3810155420 2024-06-13T11:37:18.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.709+0000 7f380cff9640 1 -- 172.21.15.43:0/3392781379 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f3808079fb0 con 0x7f3810155420 2024-06-13T11:37:18.709 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:18.709 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f37fc06be30 msgr2=0x7f37fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f37fc06be30 0x7f37fc06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3800000f60 tx=0x7f3800009040 comp rx=0 tx=0).stop 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 msgr2=0x7f381015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 0x7f381015b320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3808009e50 tx=0x7f3808004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 shutdown_connections 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f37fc06be30 0x7f37fc06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3810155420 0x7f381015b320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f38100d2a90 0x7f38101f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 --2- 172.21.15.43:0/3392781379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38100abe00 0x7f3810147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 >> 172.21.15.43:0/3392781379 conn(0x7f3810067640 msgr2=0x7f381015d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 shutdown_connections 2024-06-13T11:37:18.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.711+0000 7f38163a9640 1 -- 172.21.15.43:0/3392781379 wait complete. 2024-06-13T11:37:18.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:18.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.825+0000 7efddf819640 1 Processor -- start 2024-06-13T11:37:18.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.826+0000 7efddf819640 1 -- start start 2024-06-13T11:37:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.826+0000 7efddf819640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdd80d2a90 0x7efdd80d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.826+0000 7efddf819640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efdd80abe00 0x7efdd80ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.826+0000 7efddf819640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd80aa5d0 con 0x7efdd8155420 2024-06-13T11:37:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.826+0000 7efddf819640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80d3440 con 0x7efdd80abe00 2024-06-13T11:37:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.826+0000 7efddf819640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80aeb90 con 0x7efdd80d2a90 2024-06-13T11:37:18.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddddb6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efdd80abe00 0x7efdd80ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddd5b5640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7efdd8155420 0x7efdd80ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45060/0 (socket says 172.21.15.43:45060) 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddd5b5640 1 -- 172.21.15.43:0/2595635346 learned_addr learned my addr 172.21.15.43:0/2595635346 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddcdb4640 1 --2- 172.21.15.43:0/2595635346 >> v2:172.21.15.53:3300/0 conn(0x7efdd80d2a90 0x7efdd80d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddddb6640 1 -- 172.21.15.43:0/2595635346 >> v2:172.21.15.53:3300/0 conn(0x7efdd80d2a90 msgr2=0x7efdd80d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddddb6640 1 --2- 172.21.15.43:0/2595635346 >> v2:172.21.15.53:3300/0 conn(0x7efdd80d2a90 0x7efdd80d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddddb6640 1 -- 172.21.15.43:0/2595635346 >> v1:172.21.15.43:6789/0 conn(0x7efdd8155420 legacy=0x7efdd80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.827+0000 7efddddb6640 1 -- 172.21.15.43:0/2595635346 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd8155800 con 0x7efdd80abe00 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddddb6640 1 --2- 172.21.15.43:0/2595635346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd80abe00 0x7efdd80ac270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efdd80ad470 tx=0x7efdc802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d99934704c44450 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efdd7fff640 1 -- 172.21.15.43:0/2595635346 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8007740 con 0x7efdd80abe00 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efdd7fff640 1 -- 172.21.15.43:0/2595635346 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc80078e0 con 0x7efdd80abe00 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efdd7fff640 1 -- 172.21.15.43:0/2595635346 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8007cb0 con 0x7efdd80abe00 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddf819640 1 -- 172.21.15.43:0/2595635346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd80abe00 msgr2=0x7efdd80ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddf819640 1 --2- 172.21.15.43:0/2595635346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd80abe00 0x7efdd80ac270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efdd80ad470 tx=0x7efdc802a680 comp rx=0 tx=0).stop 2024-06-13T11:37:18.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddf819640 1 -- 172.21.15.43:0/2595635346 shutdown_connections 2024-06-13T11:37:18.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddf819640 1 --2- 172.21.15.43:0/2595635346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd80abe00 0x7efdd80ac270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddf819640 1 --2- 172.21.15.43:0/2595635346 >> v2:172.21.15.53:3300/0 conn(0x7efdd80d2a90 0x7efdd80d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.828+0000 7efddf819640 1 -- 172.21.15.43:0/2595635346 >> 172.21.15.43:0/2595635346 conn(0x7efdd8067640 msgr2=0x7efdd80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:18.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.829+0000 7efddf819640 1 -- 172.21.15.43:0/2595635346 shutdown_connections 2024-06-13T11:37:18.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.829+0000 7efddf819640 1 -- 172.21.15.43:0/2595635346 wait complete. 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 Processor -- start 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 -- start start 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd80abe00 0x7efdd814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdd80d2a90 0x7efdd814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 0x7efdd815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80aae30 con 0x7efdd8155420 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80aab50 con 0x7efdd80abe00 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.830+0000 7efddf819640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80ab110 con 0x7efdd80d2a90 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 0x7efdd815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 0x7efdd815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36348/0 (socket says 172.21.15.43:36348) 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 -- 172.21.15.43:0/3539762987 learned_addr learned my addr 172.21.15.43:0/3539762987 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:18.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddd5b5640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd80abe00 0x7efdd814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddcdb4640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdd80d2a90 0x7efdd814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 -- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdd80d2a90 msgr2=0x7efdd814da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdd80d2a90 0x7efdd814da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 -- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd80abe00 msgr2=0x7efdd814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd80abe00 0x7efdd814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 -- 172.21.15.43:0/3539762987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd814b2d0 con 0x7efdd8155420 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddddb6640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 0x7efdd815e970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efdc802ac70 tx=0x7efdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8040070 con 0x7efdd8155420 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8031bc0 con 0x7efdd8155420 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8009450 con 0x7efdd8155420 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd8156400 con 0x7efdd8155420 2024-06-13T11:37:18.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.831+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd81569c0 con 0x7efdd8155420 2024-06-13T11:37:18.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.832+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd804ffb0 con 0x7efdd8155420 2024-06-13T11:37:18.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.833+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdc8039040 con 0x7efdd8155420 2024-06-13T11:37:18.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.833+0000 7efdd5ffb640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efdc406be60 0x7efdc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:18.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.833+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efdc80ac8a0 con 0x7efdd8155420 2024-06-13T11:37:18.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.833+0000 7efddd5b5640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efdc406be60 0x7efdc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:18.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.834+0000 7efddd5b5640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efdc406be60 0x7efdc406e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efdd0007fd0 tx=0x7efdd0007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:18.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:18.838+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efdc807a8c0 con 0x7efdd8155420 2024-06-13T11:37:19.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.024+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdd815fc30 con 0x7efdd8155420 2024-06-13T11:37:19.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.025+0000 7efdd5ffb640 1 -- 172.21.15.43:0/3539762987 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7efdc807ebc0 con 0x7efdd8155420 2024-06-13T11:37:19.025 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:19.025 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efdc406be60 msgr2=0x7efdc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efdc406be60 0x7efdc406e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efdd0007fd0 tx=0x7efdd0007e80 comp rx=0 tx=0).stop 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 msgr2=0x7efdd815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 0x7efdd815e970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efdc802ac70 tx=0x7efdc8004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 shutdown_connections 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efdc406be60 0x7efdc406e320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdd8155420 0x7efdd815e970 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efdd80d2a90 0x7efdd814da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 --2- 172.21.15.43:0/3539762987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd80abe00 0x7efdd814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 >> 172.21.15.43:0/3539762987 conn(0x7efdd8067640 msgr2=0x7efdd8070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 shutdown_connections 2024-06-13T11:37:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.027+0000 7efddf819640 1 -- 172.21.15.43:0/3539762987 wait complete. 2024-06-13T11:37:19.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-13T11:37:19.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.145+0000 7fd720f63640 1 Processor -- start 2024-06-13T11:37:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.145+0000 7fd720f63640 1 -- start start 2024-06-13T11:37:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.146+0000 7fd720f63640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd71c15e460 0x7fd71c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.146+0000 7fd720f63640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd71c0d1cd0 0x7fd71c0ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.146+0000 7fd720f63640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71c0d3630 con 0x7fd71c0ae200 2024-06-13T11:37:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.146+0000 7fd720f63640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c0d3910 con 0x7fd71c0d1cd0 2024-06-13T11:37:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.146+0000 7fd720f63640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c0d3bf0 con 0x7fd71c15e460 2024-06-13T11:37:19.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd71c0d1cd0 0x7fd71c0ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd71c0d1cd0 0x7fd71c0ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36350/0 (socket says 172.21.15.43:36350) 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 -- 172.21.15.43:0/3806517377 learned_addr learned my addr 172.21.15.43:0/3806517377 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71a59c640 1 --2- 172.21.15.43:0/3806517377 >> v2:172.21.15.53:3300/0 conn(0x7fd71c15e460 0x7fd71c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 -- 172.21.15.43:0/3806517377 >> v2:172.21.15.53:3300/0 conn(0x7fd71c15e460 msgr2=0x7fd71c0aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 --2- 172.21.15.43:0/3806517377 >> v2:172.21.15.53:3300/0 conn(0x7fd71c15e460 0x7fd71c0aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 -- 172.21.15.43:0/3806517377 >> v1:172.21.15.53:6789/0 conn(0x7fd71c0ae200 legacy=0x7fd71c0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71ad9d640 1 -- 172.21.15.43:0/3806517377 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c0d3ed0 con 0x7fd71c0d1cd0 2024-06-13T11:37:19.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.147+0000 7fd71a59c640 1 --2- 172.21.15.43:0/3806517377 >> v2:172.21.15.53:3300/0 conn(0x7fd71c15e460 0x7fd71c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd71ad9d640 1 --2- 172.21.15.43:0/3806517377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c0d1cd0 0x7fd71c0ae660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0aa790 tx=0x7fd71402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6c8953c1a920df server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd71959a640 1 -- 172.21.15.43:0/3806517377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714036070 con 0x7fd71c0d1cd0 2024-06-13T11:37:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd71959a640 1 -- 172.21.15.43:0/3806517377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd714031600 con 0x7fd71c0d1cd0 2024-06-13T11:37:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd71959a640 1 -- 172.21.15.43:0/3806517377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7140319d0 con 0x7fd71c0d1cd0 2024-06-13T11:37:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 -- 172.21.15.43:0/3806517377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c0d1cd0 msgr2=0x7fd71c0ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 --2- 172.21.15.43:0/3806517377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c0d1cd0 0x7fd71c0ae660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0aa790 tx=0x7fd71402a6a0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 -- 172.21.15.43:0/3806517377 shutdown_connections 2024-06-13T11:37:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 --2- 172.21.15.43:0/3806517377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c0d1cd0 0x7fd71c0ae660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 --2- 172.21.15.43:0/3806517377 >> v2:172.21.15.53:3300/0 conn(0x7fd71c15e460 0x7fd71c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 -- 172.21.15.43:0/3806517377 >> 172.21.15.43:0/3806517377 conn(0x7fd71c0673d0 msgr2=0x7fd71c0d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 -- 172.21.15.43:0/3806517377 shutdown_connections 2024-06-13T11:37:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.148+0000 7fd720f63640 1 -- 172.21.15.43:0/3806517377 wait complete. 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.150+0000 7fd720f63640 1 Processor -- start 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.150+0000 7fd720f63640 1 -- start start 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.150+0000 7fd720f63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c0ae200 0x7fd71c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.150+0000 7fd720f63640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd71c0d1cd0 0x7fd71c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.150+0000 7fd720f63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 0x7fd71c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd720f63640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1621a0 con 0x7fd71c15e460 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd720f63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c0d32c0 con 0x7fd71c0ae200 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd720f63640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd71c162320 con 0x7fd71c0d1cd0 2024-06-13T11:37:19.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 0x7fd71c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 0x7fd71c1584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36360/0 (socket says 172.21.15.43:36360) 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 -- 172.21.15.43:0/1669495069 learned_addr learned my addr 172.21.15.43:0/1669495069 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71a59c640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c0ae200 0x7fd71c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd719d9b640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd71c0d1cd0 0x7fd71c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 -- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd71c0d1cd0 msgr2=0x7fd71c14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd71c0d1cd0 0x7fd71c14d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 -- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c0ae200 msgr2=0x7fd71c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c0ae200 0x7fd71c152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 -- 172.21.15.43:0/1669495069 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c150e70 con 0x7fd71c15e460 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd719d9b640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd71c0d1cd0 0x7fd71c14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd71ad9d640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 0x7fd71c1584e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd714009f40 tx=0x7fd714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714036050 con 0x7fd71c15e460 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd714042070 con 0x7fd71c15e460 2024-06-13T11:37:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71c151150 con 0x7fd71c15e460 2024-06-13T11:37:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714009510 con 0x7fd71c15e460 2024-06-13T11:37:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.151+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71c151710 con 0x7fd71c15e460 2024-06-13T11:37:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.152+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71c152a00 con 0x7fd71c15e460 2024-06-13T11:37:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.153+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd714007bd0 con 0x7fd71c15e460 2024-06-13T11:37:19.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.153+0000 7fd70affd640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.153+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd7140abf30 con 0x7fd71c15e460 2024-06-13T11:37:19.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.154+0000 7fd71a59c640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.154+0000 7fd71a59c640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd70c006e80 tx=0x7fd70c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:19.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.158+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd71407a630 con 0x7fd71c15e460 2024-06-13T11:37:19.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.381+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd71c0ab700 con 0x7fd71c15e460 2024-06-13T11:37:19.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.844+0000 7fd70affd640 1 -- 172.21.15.43:0/1669495069 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fd714079f30 con 0x7fd71c15e460 2024-06-13T11:37:19.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd6fc06be30 msgr2=0x7fd6fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd70c006e80 tx=0x7fd70c008040 comp rx=0 tx=0).stop 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 msgr2=0x7fd71c1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 0x7fd71c1584e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd714009f40 tx=0x7fd714004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 shutdown_connections 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd71c15e460 0x7fd71c1584e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd71c0d1cd0 0x7fd71c14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 --2- 172.21.15.43:0/1669495069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c0ae200 0x7fd71c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 >> 172.21.15.43:0/1669495069 conn(0x7fd71c0673d0 msgr2=0x7fd71c070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 shutdown_connections 2024-06-13T11:37:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.848+0000 7fd720f63640 1 -- 172.21.15.43:0/1669495069 wait complete. 2024-06-13T11:37:19.860 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-06-13T11:37:19.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-13T11:37:19.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.974+0000 7fc5eea33640 1 Processor -- start 2024-06-13T11:37:19.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.974+0000 7fc5eea33640 1 -- start start 2024-06-13T11:37:19.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5eea33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5e813f220 0x7fc5e81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5eea33640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5e8141950 0x7fc5e806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5eea33640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5e8160be0 con 0x7fc5e8141e00 2024-06-13T11:37:19.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5eea33640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e813f600 con 0x7fc5e8141950 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5eea33640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e8142380 con 0x7fc5e813f220 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5e77fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5e8141950 0x7fc5e806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5e77fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5e8141950 0x7fc5e806b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36366/0 (socket says 172.21.15.43:36366) 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.975+0000 7fc5e77fe640 1 -- 172.21.15.43:0/2087601625 learned_addr learned my addr 172.21.15.43:0/2087601625 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.976+0000 7fc5e7fff640 1 --2- 172.21.15.43:0/2087601625 >> v2:172.21.15.53:3300/0 conn(0x7fc5e813f220 0x7fc5e81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.976+0000 7fc5e77fe640 1 -- 172.21.15.43:0/2087601625 >> v2:172.21.15.53:3300/0 conn(0x7fc5e813f220 msgr2=0x7fc5e81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.976+0000 7fc5e77fe640 1 --2- 172.21.15.43:0/2087601625 >> v2:172.21.15.53:3300/0 conn(0x7fc5e813f220 0x7fc5e81606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.976+0000 7fc5e77fe640 1 -- 172.21.15.43:0/2087601625 >> v1:172.21.15.53:6789/0 conn(0x7fc5e8141e00 legacy=0x7fc5e815c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.976+0000 7fc5e77fe640 1 -- 172.21.15.43:0/2087601625 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e8142660 con 0x7fc5e8141950 2024-06-13T11:37:19.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5e77fe640 1 --2- 172.21.15.43:0/2087601625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141950 0x7fc5e806b390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc5e806c210 tx=0x7fc5dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bc3bca130352e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5e6ffd640 1 -- 172.21.15.43:0/2087601625 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc037070 con 0x7fc5e8141950 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5e6ffd640 1 -- 172.21.15.43:0/2087601625 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc032440 con 0x7fc5e8141950 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5e6ffd640 1 -- 172.21.15.43:0/2087601625 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc032810 con 0x7fc5e8141950 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 -- 172.21.15.43:0/2087601625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141950 msgr2=0x7fc5e806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2087601625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141950 0x7fc5e806b390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc5e806c210 tx=0x7fc5dc02a270 comp rx=0 tx=0).stop 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 -- 172.21.15.43:0/2087601625 shutdown_connections 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2087601625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141950 0x7fc5e806b390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2087601625 >> v2:172.21.15.53:3300/0 conn(0x7fc5e813f220 0x7fc5e81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 -- 172.21.15.43:0/2087601625 >> 172.21.15.43:0/2087601625 conn(0x7fc5e8070810 msgr2=0x7fc5e8070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 -- 172.21.15.43:0/2087601625 shutdown_connections 2024-06-13T11:37:19.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.977+0000 7fc5eea33640 1 -- 172.21.15.43:0/2087601625 wait complete. 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.979+0000 7fc5eea33640 1 Processor -- start 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.979+0000 7fc5eea33640 1 -- start start 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5e813f220 0x7fc5e814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5e8141950 0x7fc5e81f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 0x7fc5e813dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e80d1df0 con 0x7fc5e8141e00 2024-06-13T11:37:19.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8160180 con 0x7fc5e8141950 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e80d1f70 con 0x7fc5e813f220 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 0x7fc5e813dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 0x7fc5e813dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36374/0 (socket says 172.21.15.43:36374) 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 -- 172.21.15.43:0/2065426781 learned_addr learned my addr 172.21.15.43:0/2065426781 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5e77fe640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5e8141950 0x7fc5e81f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5e7fff640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5e813f220 0x7fc5e814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 -- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5e813f220 msgr2=0x7fc5e814d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5e813f220 0x7fc5e814d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 -- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5e8141950 msgr2=0x7fc5e81f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5e8141950 0x7fc5e81f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 -- 172.21.15.43:0/2065426781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e81f2320 con 0x7fc5e8141e00 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5ecfd0640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 0x7fc5e813dc20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c6b0 tx=0x7fc5e000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:19.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003b70 con 0x7fc5e8141e00 2024-06-13T11:37:19.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e0003d30 con 0x7fc5e8141e00 2024-06-13T11:37:19.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e813cb80 con 0x7fc5e8141e00 2024-06-13T11:37:19.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0005310 con 0x7fc5e8141e00 2024-06-13T11:37:19.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.980+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e813d140 con 0x7fc5e8141e00 2024-06-13T11:37:19.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.981+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e80b37f0 con 0x7fc5e8141e00 2024-06-13T11:37:19.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.982+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5e00054b0 con 0x7fc5e8141e00 2024-06-13T11:37:19.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.982+0000 7fc5e4ff9640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc5d406be30 0x7fc5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:19.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.983+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5e008aeb0 con 0x7fc5e8141e00 2024-06-13T11:37:19.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.983+0000 7fc5e7fff640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc5d406be30 0x7fc5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:19.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.983+0000 7fc5e7fff640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc5d406be30 0x7fc5d406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:19.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:19.987+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc5e80b37f0 con 0x7fc5e8141e00 2024-06-13T11:37:20.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.213+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc5e804ffb0 con 0x7fc5e8141e00 2024-06-13T11:37:20.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.845+0000 7fc5e4ff9640 1 -- 172.21.15.43:0/2065426781 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fc5e81f2320 con 0x7fc5e8141e00 2024-06-13T11:37:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc5d406be30 msgr2=0x7fc5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc5d406be30 0x7fc5d406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d8008040 comp rx=0 tx=0).stop 2024-06-13T11:37:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 msgr2=0x7fc5e813dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 0x7fc5e813dc20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c6b0 tx=0x7fc5e000cb70 comp rx=0 tx=0).stop 2024-06-13T11:37:20.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 shutdown_connections 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc5d406be30 0x7fc5d406e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5e8141e00 0x7fc5e813dc20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5e8141950 0x7fc5e81f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 --2- 172.21.15.43:0/2065426781 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc5e813f220 0x7fc5e814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 >> 172.21.15.43:0/2065426781 conn(0x7fc5e8070810 msgr2=0x7fc5e815a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 shutdown_connections 2024-06-13T11:37:20.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.849+0000 7fc5eea33640 1 -- 172.21.15.43:0/2065426781 wait complete. 2024-06-13T11:37:20.861 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-13T11:37:20.862 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:20.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.973+0000 7f21b1f9e640 1 Processor -- start 2024-06-13T11:37:20.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.973+0000 7f21b1f9e640 1 -- start start 2024-06-13T11:37:20.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b1f9e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac13f220 0x7f21ac0d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:20.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b1f9e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f21ac06baa0 0x7f21ac0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:20.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b1f9e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac0d0a40 con 0x7f21ac0a9e40 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b1f9e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f21ac15ca40 con 0x7f21ac06baa0 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b1f9e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac0d0d20 con 0x7f21ac13f220 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21a3fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f21ac0a9e40 0x7f21ac06b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45068/0 (socket says 172.21.15.43:45068) 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21a3fff640 1 -- 172.21.15.43:0/1064399026 learned_addr learned my addr 172.21.15.43:0/1064399026 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b179d640 1 --2- 172.21.15.43:0/1064399026 >> v2:172.21.15.43:3300/0 conn(0x7f21ac06baa0 0x7f21ac0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b0f9c640 1 --2- 172.21.15.43:0/1064399026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac13f220 0x7f21ac0d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21a37fe640 1 -- 172.21.15.43:0/1064399026 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569785283 0 0) 0x7f21ac0d0a40 con 0x7f21ac0a9e40 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21a37fe640 1 -- 172.21.15.43:0/1064399026 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2194003520 con 0x7f21ac0a9e40 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b179d640 1 -- 172.21.15.43:0/1064399026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac13f220 msgr2=0x7f21ac0d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b179d640 1 --2- 172.21.15.43:0/1064399026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac13f220 0x7f21ac0d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b179d640 1 -- 172.21.15.43:0/1064399026 >> v1:172.21.15.43:6789/0 conn(0x7f21ac0a9e40 legacy=0x7f21ac06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:20.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.974+0000 7f21b179d640 1 -- 172.21.15.43:0/1064399026 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0d1000 con 0x7f21ac06baa0 2024-06-13T11:37:20.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.975+0000 7f21b179d640 1 --2- 172.21.15.43:0/1064399026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac06baa0 0x7f21ac0aa2a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009d90 tx=0x7f21a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77b498c40494393 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.975+0000 7f21a37fe640 1 -- 172.21.15.43:0/1064399026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4007740 con 0x7f21ac06baa0 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.975+0000 7f21a37fe640 1 -- 172.21.15.43:0/1064399026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a40078e0 con 0x7f21ac06baa0 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.975+0000 7f21a37fe640 1 -- 172.21.15.43:0/1064399026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4007cb0 con 0x7f21ac06baa0 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 -- 172.21.15.43:0/1064399026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac06baa0 msgr2=0x7f21ac0aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/1064399026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac06baa0 0x7f21ac0aa2a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009d90 tx=0x7f21a402a660 comp rx=0 tx=0).stop 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 -- 172.21.15.43:0/1064399026 shutdown_connections 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/1064399026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac06baa0 0x7f21ac0aa2a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/1064399026 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac13f220 0x7f21ac0d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 -- 172.21.15.43:0/1064399026 >> 172.21.15.43:0/1064399026 conn(0x7f21ac06cb10 msgr2=0x7f21ac06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 -- 172.21.15.43:0/1064399026 shutdown_connections 2024-06-13T11:37:20.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.976+0000 7f21b1f9e640 1 -- 172.21.15.43:0/1064399026 wait complete. 2024-06-13T11:37:20.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.977+0000 7f21b1f9e640 1 Processor -- start 2024-06-13T11:37:20.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.977+0000 7f21b1f9e640 1 -- start start 2024-06-13T11:37:20.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b1f9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21ac06baa0 0x7f21ac1edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b1f9e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac0a9e40 0x7f21ac1f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b1f9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 0x7f21ac0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b1f9e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0d2020 con 0x7f21ac13f220 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b1f9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0d15c0 con 0x7f21ac06baa0 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b1f9e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac13f850 con 0x7f21ac0a9e40 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b179d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 0x7f21ac0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b179d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 0x7f21ac0c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36390/0 (socket says 172.21.15.43:36390) 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.978+0000 7f21b179d640 1 -- 172.21.15.43:0/3593064432 learned_addr learned my addr 172.21.15.43:0/3593064432 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b0f9c640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21ac06baa0 0x7f21ac1edfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21a3fff640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac0a9e40 0x7f21ac1f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b179d640 1 -- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac0a9e40 msgr2=0x7f21ac1f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b179d640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac0a9e40 0x7f21ac1f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b179d640 1 -- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21ac06baa0 msgr2=0x7f21ac1edfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:20.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b179d640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21ac06baa0 0x7f21ac1edfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b179d640 1 -- 172.21.15.43:0/3593064432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0c3d20 con 0x7f21ac13f220 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b179d640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 0x7f21ac0c4570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f21a402ac50 tx=0x7f21a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4040070 con 0x7f21ac13f220 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a4031bc0 con 0x7f21ac13f220 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4009450 con 0x7f21ac13f220 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac0c4000 con 0x7f21ac13f220 2024-06-13T11:37:20.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.979+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac0c4ab0 con 0x7f21ac13f220 2024-06-13T11:37:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.980+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ac0c4200 con 0x7f21ac13f220 2024-06-13T11:37:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.981+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21a4039040 con 0x7f21ac13f220 2024-06-13T11:37:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.981+0000 7f21a17fa640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f219806be60 0x7f219806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.981+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f21a40aca60 con 0x7f21ac13f220 2024-06-13T11:37:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.982+0000 7f21b0f9c640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f219806be60 0x7f219806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:20.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.982+0000 7f21b0f9c640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f219806be60 0x7f219806e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009a30 tx=0x7f21a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:20.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:20.986+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f21a407b280 con 0x7f21ac13f220 2024-06-13T11:37:21.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.213+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21ac04fcb0 con 0x7f21ac13f220 2024-06-13T11:37:21.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.213+0000 7f21a17fa640 1 -- 172.21.15.43:0/3593064432 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f21a407ab80 con 0x7f21ac13f220 2024-06-13T11:37:21.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:21.213 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:21.213 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f219806be60 msgr2=0x7f219806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f219806be60 0x7f219806e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009a30 tx=0x7f21a8008040 comp rx=0 tx=0).stop 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 msgr2=0x7f21ac0c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 0x7f21ac0c4570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f21a402ac50 tx=0x7f21a4004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 shutdown_connections 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f219806be60 0x7f219806e320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21ac13f220 0x7f21ac0c4570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21ac0a9e40 0x7f21ac1f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 --2- 172.21.15.43:0/3593064432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21ac06baa0 0x7f21ac1edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 >> 172.21.15.43:0/3593064432 conn(0x7f21ac06cb10 msgr2=0x7f21ac140620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:21.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 shutdown_connections 2024-06-13T11:37:21.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.215+0000 7f21b1f9e640 1 -- 172.21.15.43:0/3593064432 wait complete. 2024-06-13T11:37:21.225 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:21.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.330+0000 7ff380161640 1 Processor -- start 2024-06-13T11:37:21.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.330+0000 7ff380161640 1 -- start start 2024-06-13T11:37:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff380161640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff3781412d0 0x7ff37806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff380161640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff378162640 0x7ff3780b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff380161640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3781416b0 con 0x7ff37806f090 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff380161640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff378162a70 con 0x7ff3781412d0 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff380161640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff378162cd0 con 0x7ff378162640 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37defd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff3781412d0 0x7ff37806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37d6fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff37806f090 0x7ff378161f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45072/0 (socket says 172.21.15.43:45072) 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37defd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff3781412d0 0x7ff37806eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36398/0 (socket says 172.21.15.43:36398) 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37d6fc640 1 -- 172.21.15.43:0/2778548126 learned_addr learned my addr 172.21.15.43:0/2778548126 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37e6fe640 1 --2- 172.21.15.43:0/2778548126 >> v2:172.21.15.53:3300/0 conn(0x7ff378162640 0x7ff3780b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37defd640 1 -- 172.21.15.43:0/2778548126 >> v2:172.21.15.53:3300/0 conn(0x7ff378162640 msgr2=0x7ff3780b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37defd640 1 --2- 172.21.15.43:0/2778548126 >> v2:172.21.15.53:3300/0 conn(0x7ff378162640 0x7ff3780b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37defd640 1 -- 172.21.15.43:0/2778548126 >> v1:172.21.15.43:6789/0 conn(0x7ff37806f090 legacy=0x7ff378161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37defd640 1 -- 172.21.15.43:0/2778548126 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37815ebe0 con 0x7ff3781412d0 2024-06-13T11:37:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.331+0000 7ff37e6fe640 1 --2- 172.21.15.43:0/2778548126 >> v2:172.21.15.53:3300/0 conn(0x7ff378162640 0x7ff3780b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.332+0000 7ff37defd640 1 --2- 172.21.15.43:0/2778548126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff37806eb50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3780b1e80 tx=0x7ff37402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4922c85e7097986f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.332+0000 7ff37cefb640 1 -- 172.21.15.43:0/2778548126 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374037070 con 0x7ff3781412d0 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.332+0000 7ff37cefb640 1 -- 172.21.15.43:0/2778548126 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff374032440 con 0x7ff3781412d0 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.332+0000 7ff37cefb640 1 -- 172.21.15.43:0/2778548126 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374032810 con 0x7ff3781412d0 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 -- 172.21.15.43:0/2778548126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 msgr2=0x7ff37806eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 --2- 172.21.15.43:0/2778548126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff37806eb50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3780b1e80 tx=0x7ff37402a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 -- 172.21.15.43:0/2778548126 shutdown_connections 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 --2- 172.21.15.43:0/2778548126 >> v2:172.21.15.53:3300/0 conn(0x7ff378162640 0x7ff3780b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 --2- 172.21.15.43:0/2778548126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff37806eb50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 -- 172.21.15.43:0/2778548126 >> 172.21.15.43:0/2778548126 conn(0x7ff37806e030 msgr2=0x7ff37806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 -- 172.21.15.43:0/2778548126 shutdown_connections 2024-06-13T11:37:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.333+0000 7ff380161640 1 -- 172.21.15.43:0/2778548126 wait complete. 2024-06-13T11:37:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.334+0000 7ff380161640 1 Processor -- start 2024-06-13T11:37:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.334+0000 7ff380161640 1 -- start start 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff37806f090 0x7ff3780cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff3781549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff378162640 0x7ff378156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff37815e890 con 0x7ff3781412d0 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff37815f1a0 con 0x7ff378162640 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff37815f6c0 con 0x7ff37806f090 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff3781549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff3781549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36410/0 (socket says 172.21.15.43:36410) 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 -- 172.21.15.43:0/959933464 learned_addr learned my addr 172.21.15.43:0/959933464 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37e6fe640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff378162640 0x7ff378156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37defd640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff37806f090 0x7ff3780cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 -- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff37806f090 msgr2=0x7ff3780cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff37806f090 0x7ff3780cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 -- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff378162640 msgr2=0x7ff378156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff378162640 0x7ff378156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 -- 172.21.15.43:0/959933464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3780cf500 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37defd640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff37806f090 0x7ff3780cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff37d6fc640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff3781549b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c3f0 tx=0x7ff36800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368017070 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff368005ce0 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3780cf7e0 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3680072f0 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.335+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3780cf100 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.336+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37804ffb0 con 0x7ff3781412d0 2024-06-13T11:37:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.337+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff36801a070 con 0x7ff3781412d0 2024-06-13T11:37:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.337+0000 7ff36e7fc640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff35c06be30 0x7ff35c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.338+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff36808a3c0 con 0x7ff3781412d0 2024-06-13T11:37:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.338+0000 7ff37defd640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff35c06be30 0x7ff35c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.338+0000 7ff37defd640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff35c06be30 0x7ff35c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff374034000 tx=0x7ff37402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.342+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff368058470 con 0x7ff3781412d0 2024-06-13T11:37:21.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.527+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3780d10f0 con 0x7ff3781412d0 2024-06-13T11:37:21.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.528+0000 7ff36e7fc640 1 -- 172.21.15.43:0/959933464 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7ff36805c770 con 0x7ff3781412d0 2024-06-13T11:37:21.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:21.528 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff35c06be30 msgr2=0x7ff35c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff35c06be30 0x7ff35c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff374034000 tx=0x7ff37402e000 comp rx=0 tx=0).stop 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 msgr2=0x7ff3781549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff3781549b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c3f0 tx=0x7ff36800c8b0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 shutdown_connections 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff35c06be30 0x7ff35c06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff378162640 0x7ff378156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3781412d0 0x7ff3781549b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 --2- 172.21.15.43:0/959933464 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff37806f090 0x7ff3780cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 >> 172.21.15.43:0/959933464 conn(0x7ff37806e030 msgr2=0x7ff37806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:21.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 shutdown_connections 2024-06-13T11:37:21.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.530+0000 7ff380161640 1 -- 172.21.15.43:0/959933464 wait complete. 2024-06-13T11:37:21.540 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-13T11:37:21.541 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:37:21.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.646+0000 7f428c838640 1 Processor -- start 2024-06-13T11:37:21.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.646+0000 7f428c838640 1 -- start start 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428c838640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42880b6a70 0x7f428815f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428c838640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b78a0 0x7f42880b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428c838640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4288071d50 con 0x7f4288161e20 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428c838640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f428815ef90 con 0x7f42880b6a70 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428c838640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4288162a00 con 0x7f42880b78a0 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42880b6a70 0x7f428815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42880b6a70 0x7f428815f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36422/0 (socket says 172.21.15.43:36422) 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 -- 172.21.15.43:0/1023196165 learned_addr learned my addr 172.21.15.43:0/1023196165 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 -- 172.21.15.43:0/1023196165 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b78a0 msgr2=0x7f42880b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 --2- 172.21.15.43:0/1023196165 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b78a0 0x7f42880b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 -- 172.21.15.43:0/1023196165 >> v1:172.21.15.53:6789/0 conn(0x7f4288161e20 legacy=0x7f42880b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:21.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.647+0000 7f428659c640 1 -- 172.21.15.43:0/1023196165 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4288162ce0 con 0x7f42880b6a70 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.648+0000 7f428659c640 1 --2- 172.21.15.43:0/1023196165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42880b6a70 0x7f428815f420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4280009e50 tx=0x7f428002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baead08530976403 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.648+0000 7f428559a640 1 -- 172.21.15.43:0/1023196165 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280036070 con 0x7f42880b6a70 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.648+0000 7f428559a640 1 -- 172.21.15.43:0/1023196165 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4280031600 con 0x7f42880b6a70 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.648+0000 7f428559a640 1 -- 172.21.15.43:0/1023196165 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42800319d0 con 0x7f42880b6a70 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 -- 172.21.15.43:0/1023196165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42880b6a70 msgr2=0x7f428815f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 --2- 172.21.15.43:0/1023196165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42880b6a70 0x7f428815f420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4280009e50 tx=0x7f428002a630 comp rx=0 tx=0).stop 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 -- 172.21.15.43:0/1023196165 shutdown_connections 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 --2- 172.21.15.43:0/1023196165 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b78a0 0x7f42880b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 --2- 172.21.15.43:0/1023196165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42880b6a70 0x7f428815f420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 -- 172.21.15.43:0/1023196165 >> 172.21.15.43:0/1023196165 conn(0x7f428806f110 msgr2=0x7f428806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:21.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 -- 172.21.15.43:0/1023196165 shutdown_connections 2024-06-13T11:37:21.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.649+0000 7f428c838640 1 -- 172.21.15.43:0/1023196165 wait complete. 2024-06-13T11:37:21.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.650+0000 7f428c838640 1 Processor -- start 2024-06-13T11:37:21.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.650+0000 7f428c838640 1 -- start start 2024-06-13T11:37:21.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428c838640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b6a70 0x7f4288143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428c838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42880b78a0 0x7f4288147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428c838640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 0x7f4288145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428c838640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f42880b6e50 con 0x7f4288161e20 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428c838640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f428815ec20 con 0x7f42880b78a0 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428c838640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f42881622b0 con 0x7f42880b6a70 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f4286d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 0x7f4288145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f4286d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 0x7f4288145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36430/0 (socket says 172.21.15.43:36430) 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f4286d9d640 1 -- 172.21.15.43:0/789187704 learned_addr learned my addr 172.21.15.43:0/789187704 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f4285d9b640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42880b78a0 0x7f4288147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.651+0000 7f428659c640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b6a70 0x7f4288143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f4286d9d640 1 -- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b6a70 msgr2=0x7f4288143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f4286d9d640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b6a70 0x7f4288143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f4286d9d640 1 -- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42880b78a0 msgr2=0x7f4288147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f4286d9d640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42880b78a0 0x7f4288147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f4286d9d640 1 -- 172.21.15.43:0/789187704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42881442b0 con 0x7f4288161e20 2024-06-13T11:37:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f4286d9d640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 0x7f4288145350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f427800b410 tx=0x7f427800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278015030 con 0x7f4288161e20 2024-06-13T11:37:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4278004020 con 0x7f4288161e20 2024-06-13T11:37:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4288144590 con 0x7f4288161e20 2024-06-13T11:37:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278004410 con 0x7f4288161e20 2024-06-13T11:37:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.652+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4288144b50 con 0x7f4288161e20 2024-06-13T11:37:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.653+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428804ffb0 con 0x7f4288161e20 2024-06-13T11:37:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.654+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4278018070 con 0x7f4288161e20 2024-06-13T11:37:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.654+0000 7f427effd640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f426806be30 0x7f426806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.654+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f427808abc0 con 0x7f4288161e20 2024-06-13T11:37:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.654+0000 7f428659c640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f426806be30 0x7f426806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:21.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.655+0000 7f428659c640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f426806be30 0x7f426806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4280033000 tx=0x7f4280009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:21.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.658+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4278059230 con 0x7f4288161e20 2024-06-13T11:37:21.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.838+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42880b7330 con 0x7f426806be30 2024-06-13T11:37:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.848+0000 7f427effd640 1 -- 172.21.15.43:0/789187704 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332633 (secure 0 0 0) 0x7f42880b7330 con 0x7f426806be30 2024-06-13T11:37:21.851 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:21.852 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:37:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f426806be30 msgr2=0x7f426806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f426806be30 0x7f426806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4280033000 tx=0x7f4280009000 comp rx=0 tx=0).stop 2024-06-13T11:37:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 msgr2=0x7f4288145350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 0x7f4288145350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f427800b410 tx=0x7f427800b810 comp rx=0 tx=0).stop 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 shutdown_connections 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f426806be30 0x7f426806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4288161e20 0x7f4288145350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42880b78a0 0x7f4288147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 --2- 172.21.15.43:0/789187704 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42880b6a70 0x7f4288143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 >> 172.21.15.43:0/789187704 conn(0x7f428806f110 msgr2=0x7f4288160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 shutdown_connections 2024-06-13T11:37:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:21.852+0000 7f428c838640 1 -- 172.21.15.43:0/789187704 wait complete. 2024-06-13T11:37:21.862 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-06-13T11:37:21.352020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252728,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721992,"statfs":{"total":773094113280,"available":772835319808,"internally_reserved":0,"allocated":3350528,"data_stored":2017313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.536279"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713160+0000","last_change":"2024-06-13T11:37:06.802024+0000","last_active":"2024-06-13T11:37:13.713160+0000","last_peered":"2024-06-13T11:37:13.713160+0000","last_clean":"2024-06-13T11:37:13.713160+0000","last_became_active":"2024-06-13T11:37:06.801691+0000","last_became_peered":"2024-06-13T11:37:06.801691+0000","last_unstale":"2024-06-13T11:37:13.713160+0000","last_undegraded":"2024-06-13T11:37:13.713160+0000","last_fullsized":"2024-06-13T11:37:13.713160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713972+0000","last_change":"2024-06-13T11:37:07.811931+0000","last_active":"2024-06-13T11:37:13.713972+0000","last_peered":"2024-06-13T11:37:13.713972+0000","last_clean":"2024-06-13T11:37:13.713972+0000","last_became_active":"2024-06-13T11:37:07.811664+0000","last_became_peered":"2024-06-13T11:37:07.811664+0000","last_unstale":"2024-06-13T11:37:13.713972+0000","last_undegraded":"2024-06-13T11:37:13.713972+0000","last_fullsized":"2024-06-13T11:37:13.713972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713382+0000","last_change":"2024-06-13T11:37:12.056726+0000","last_active":"2024-06-13T11:37:13.713382+0000","last_peered":"2024-06-13T11:37:13.713382+0000","last_clean":"2024-06-13T11:37:13.713382+0000","last_became_active":"2024-06-13T11:37:12.056325+0000","last_became_peered":"2024-06-13T11:37:12.056325+0000","last_unstale":"2024-06-13T11:37:13.713382+0000","last_undegraded":"2024-06-13T11:37:13.713382+0000","last_fullsized":"2024-06-13T11:37:13.713382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.767571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714115+0000","last_change":"2024-06-13T11:37:06.796164+0000","last_active":"2024-06-13T11:37:13.714115+0000","last_peered":"2024-06-13T11:37:13.714115+0000","last_clean":"2024-06-13T11:37:13.714115+0000","last_became_active":"2024-06-13T11:37:06.795879+0000","last_became_peered":"2024-06-13T11:37:06.795879+0000","last_unstale":"2024-06-13T11:37:13.714115+0000","last_undegraded":"2024-06-13T11:37:13.714115+0000","last_fullsized":"2024-06-13T11:37:13.714115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712971+0000","last_change":"2024-06-13T11:37:07.816817+0000","last_active":"2024-06-13T11:37:13.712971+0000","last_peered":"2024-06-13T11:37:13.712971+0000","last_clean":"2024-06-13T11:37:13.712971+0000","last_became_active":"2024-06-13T11:37:07.816501+0000","last_became_peered":"2024-06-13T11:37:07.816501+0000","last_unstale":"2024-06-13T11:37:13.712971+0000","last_undegraded":"2024-06-13T11:37:13.712971+0000","last_fullsized":"2024-06-13T11:37:13.712971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819271+0000","last_change":"2024-06-13T11:37:11.840979+0000","last_active":"2024-06-13T11:37:12.819271+0000","last_peered":"2024-06-13T11:37:12.819271+0000","last_clean":"2024-06-13T11:37:12.819271+0000","last_became_active":"2024-06-13T11:37:11.840530+0000","last_became_peered":"2024-06-13T11:37:11.840530+0000","last_unstale":"2024-06-13T11:37:12.819271+0000","last_undegraded":"2024-06-13T11:37:12.819271+0000","last_fullsized":"2024-06-13T11:37:12.819271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:49.007922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152993+0000","last_change":"2024-06-13T11:37:06.804220+0000","last_active":"2024-06-13T11:37:13.152993+0000","last_peered":"2024-06-13T11:37:13.152993+0000","last_clean":"2024-06-13T11:37:13.152993+0000","last_became_active":"2024-06-13T11:37:06.803905+0000","last_became_peered":"2024-06-13T11:37:06.803905+0000","last_unstale":"2024-06-13T11:37:13.152993+0000","last_undegraded":"2024-06-13T11:37:13.152993+0000","last_fullsized":"2024-06-13T11:37:13.152993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168438+0000","last_change":"2024-06-13T11:37:07.818064+0000","last_active":"2024-06-13T11:37:13.168438+0000","last_peered":"2024-06-13T11:37:13.168438+0000","last_clean":"2024-06-13T11:37:13.168438+0000","last_became_active":"2024-06-13T11:37:07.817790+0000","last_became_peered":"2024-06-13T11:37:07.817790+0000","last_unstale":"2024-06-13T11:37:13.168438+0000","last_undegraded":"2024-06-13T11:37:13.168438+0000","last_fullsized":"2024-06-13T11:37:13.168438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819367+0000","last_change":"2024-06-13T11:37:11.843208+0000","last_active":"2024-06-13T11:37:12.819367+0000","last_peered":"2024-06-13T11:37:12.819367+0000","last_clean":"2024-06-13T11:37:12.819367+0000","last_became_active":"2024-06-13T11:37:11.842808+0000","last_became_peered":"2024-06-13T11:37:11.842808+0000","last_unstale":"2024-06-13T11:37:12.819367+0000","last_undegraded":"2024-06-13T11:37:12.819367+0000","last_fullsized":"2024-06-13T11:37:12.819367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:39.425819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152791+0000","last_change":"2024-06-13T11:37:06.806036+0000","last_active":"2024-06-13T11:37:13.152791+0000","last_peered":"2024-06-13T11:37:13.152791+0000","last_clean":"2024-06-13T11:37:13.152791+0000","last_became_active":"2024-06-13T11:37:06.805633+0000","last_became_peered":"2024-06-13T11:37:06.805633+0000","last_unstale":"2024-06-13T11:37:13.152791+0000","last_undegraded":"2024-06-13T11:37:13.152791+0000","last_fullsized":"2024-06-13T11:37:13.152791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168608+0000","last_change":"2024-06-13T11:37:07.818181+0000","last_active":"2024-06-13T11:37:13.168608+0000","last_peered":"2024-06-13T11:37:13.168608+0000","last_clean":"2024-06-13T11:37:13.168608+0000","last_became_active":"2024-06-13T11:37:07.817838+0000","last_became_peered":"2024-06-13T11:37:07.817838+0000","last_unstale":"2024-06-13T11:37:13.168608+0000","last_undegraded":"2024-06-13T11:37:13.168608+0000","last_fullsized":"2024-06-13T11:37:13.168608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819379+0000","last_change":"2024-06-13T11:37:11.836030+0000","last_active":"2024-06-13T11:37:12.819379+0000","last_peered":"2024-06-13T11:37:12.819379+0000","last_clean":"2024-06-13T11:37:12.819379+0000","last_became_active":"2024-06-13T11:37:11.835623+0000","last_became_peered":"2024-06-13T11:37:11.835623+0000","last_unstale":"2024-06-13T11:37:12.819379+0000","last_undegraded":"2024-06-13T11:37:12.819379+0000","last_fullsized":"2024-06-13T11:37:12.819379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:15.824916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821023+0000","last_change":"2024-06-13T11:37:07.801421+0000","last_active":"2024-06-13T11:37:12.821023+0000","last_peered":"2024-06-13T11:37:12.821023+0000","last_clean":"2024-06-13T11:37:12.821023+0000","last_became_active":"2024-06-13T11:37:07.801091+0000","last_became_peered":"2024-06-13T11:37:07.801091+0000","last_unstale":"2024-06-13T11:37:12.821023+0000","last_undegraded":"2024-06-13T11:37:12.821023+0000","last_fullsized":"2024-06-13T11:37:12.821023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152797+0000","last_change":"2024-06-13T11:37:06.800654+0000","last_active":"2024-06-13T11:37:13.152797+0000","last_peered":"2024-06-13T11:37:13.152797+0000","last_clean":"2024-06-13T11:37:13.152797+0000","last_became_active":"2024-06-13T11:37:06.800354+0000","last_became_peered":"2024-06-13T11:37:06.800354+0000","last_unstale":"2024-06-13T11:37:13.152797+0000","last_undegraded":"2024-06-13T11:37:13.152797+0000","last_fullsized":"2024-06-13T11:37:13.152797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:30.194270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821793+0000","last_change":"2024-06-13T11:37:11.844730+0000","last_active":"2024-06-13T11:37:12.821793+0000","last_peered":"2024-06-13T11:37:12.821793+0000","last_clean":"2024-06-13T11:37:12.821793+0000","last_became_active":"2024-06-13T11:37:11.844339+0000","last_became_peered":"2024-06-13T11:37:11.844339+0000","last_unstale":"2024-06-13T11:37:12.821793+0000","last_undegraded":"2024-06-13T11:37:12.821793+0000","last_fullsized":"2024-06-13T11:37:12.821793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:55.671685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713768+0000","last_change":"2024-06-13T11:37:07.814526+0000","last_active":"2024-06-13T11:37:13.713768+0000","last_peered":"2024-06-13T11:37:13.713768+0000","last_clean":"2024-06-13T11:37:13.713768+0000","last_became_active":"2024-06-13T11:37:07.814074+0000","last_became_peered":"2024-06-13T11:37:07.814074+0000","last_unstale":"2024-06-13T11:37:13.713768+0000","last_undegraded":"2024-06-13T11:37:13.713768+0000","last_fullsized":"2024-06-13T11:37:13.713768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820029+0000","last_change":"2024-06-13T11:37:06.796287+0000","last_active":"2024-06-13T11:37:12.820029+0000","last_peered":"2024-06-13T11:37:12.820029+0000","last_clean":"2024-06-13T11:37:12.820029+0000","last_became_active":"2024-06-13T11:37:06.796000+0000","last_became_peered":"2024-06-13T11:37:06.796000+0000","last_unstale":"2024-06-13T11:37:12.820029+0000","last_undegraded":"2024-06-13T11:37:12.820029+0000","last_fullsized":"2024-06-13T11:37:12.820029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820470+0000","last_change":"2024-06-13T11:37:11.842232+0000","last_active":"2024-06-13T11:37:12.820470+0000","last_peered":"2024-06-13T11:37:12.820470+0000","last_clean":"2024-06-13T11:37:12.820470+0000","last_became_active":"2024-06-13T11:37:11.841627+0000","last_became_peered":"2024-06-13T11:37:11.841627+0000","last_unstale":"2024-06-13T11:37:12.820470+0000","last_undegraded":"2024-06-13T11:37:12.820470+0000","last_fullsized":"2024-06-13T11:37:12.820470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:18.353072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712704+0000","last_change":"2024-06-13T11:37:07.811429+0000","last_active":"2024-06-13T11:37:13.712704+0000","last_peered":"2024-06-13T11:37:13.712704+0000","last_clean":"2024-06-13T11:37:13.712704+0000","last_became_active":"2024-06-13T11:37:07.811115+0000","last_became_peered":"2024-06-13T11:37:07.811115+0000","last_unstale":"2024-06-13T11:37:13.712704+0000","last_undegraded":"2024-06-13T11:37:13.712704+0000","last_fullsized":"2024-06-13T11:37:13.712704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819414+0000","last_change":"2024-06-13T11:37:06.800946+0000","last_active":"2024-06-13T11:37:12.819414+0000","last_peered":"2024-06-13T11:37:12.819414+0000","last_clean":"2024-06-13T11:37:12.819414+0000","last_became_active":"2024-06-13T11:37:06.800694+0000","last_became_peered":"2024-06-13T11:37:06.800694+0000","last_unstale":"2024-06-13T11:37:12.819414+0000","last_undegraded":"2024-06-13T11:37:12.819414+0000","last_fullsized":"2024-06-13T11:37:12.819414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820472+0000","last_change":"2024-06-13T11:37:12.056325+0000","last_active":"2024-06-13T11:37:12.820472+0000","last_peered":"2024-06-13T11:37:12.820472+0000","last_clean":"2024-06-13T11:37:12.820472+0000","last_became_active":"2024-06-13T11:37:12.055942+0000","last_became_peered":"2024-06-13T11:37:12.055942+0000","last_unstale":"2024-06-13T11:37:12.820472+0000","last_undegraded":"2024-06-13T11:37:12.820472+0000","last_fullsized":"2024-06-13T11:37:12.820472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819614+0000","last_change":"2024-06-13T11:37:07.802398+0000","last_active":"2024-06-13T11:37:12.819614+0000","last_peered":"2024-06-13T11:37:12.819614+0000","last_clean":"2024-06-13T11:37:12.819614+0000","last_became_active":"2024-06-13T11:37:07.799881+0000","last_became_peered":"2024-06-13T11:37:07.799881+0000","last_unstale":"2024-06-13T11:37:12.819614+0000","last_undegraded":"2024-06-13T11:37:12.819614+0000","last_fullsized":"2024-06-13T11:37:12.819614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:48.876977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152403+0000","last_change":"2024-06-13T11:37:06.801936+0000","last_active":"2024-06-13T11:37:13.152403+0000","last_peered":"2024-06-13T11:37:13.152403+0000","last_clean":"2024-06-13T11:37:13.152403+0000","last_became_active":"2024-06-13T11:37:06.801627+0000","last_became_peered":"2024-06-13T11:37:06.801627+0000","last_unstale":"2024-06-13T11:37:13.152403+0000","last_undegraded":"2024-06-13T11:37:13.152403+0000","last_fullsized":"2024-06-13T11:37:13.152403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:47.872930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821463+0000","last_change":"2024-06-13T11:37:11.842008+0000","last_active":"2024-06-13T11:37:12.821463+0000","last_peered":"2024-06-13T11:37:12.821463+0000","last_clean":"2024-06-13T11:37:12.821463+0000","last_became_active":"2024-06-13T11:37:11.840561+0000","last_became_peered":"2024-06-13T11:37:11.840561+0000","last_unstale":"2024-06-13T11:37:12.821463+0000","last_undegraded":"2024-06-13T11:37:12.821463+0000","last_fullsized":"2024-06-13T11:37:12.821463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:08.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713459+0000","last_change":"2024-06-13T11:37:07.805913+0000","last_active":"2024-06-13T11:37:13.713459+0000","last_peered":"2024-06-13T11:37:13.713459+0000","last_clean":"2024-06-13T11:37:13.713459+0000","last_became_active":"2024-06-13T11:37:07.805604+0000","last_became_peered":"2024-06-13T11:37:07.805604+0000","last_unstale":"2024-06-13T11:37:13.713459+0000","last_undegraded":"2024-06-13T11:37:13.713459+0000","last_fullsized":"2024-06-13T11:37:13.713459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821692+0000","last_change":"2024-06-13T11:37:06.798167+0000","last_active":"2024-06-13T11:37:12.821692+0000","last_peered":"2024-06-13T11:37:12.821692+0000","last_clean":"2024-06-13T11:37:12.821692+0000","last_became_active":"2024-06-13T11:37:06.797830+0000","last_became_peered":"2024-06-13T11:37:06.797830+0000","last_unstale":"2024-06-13T11:37:12.821692+0000","last_undegraded":"2024-06-13T11:37:12.821692+0000","last_fullsized":"2024-06-13T11:37:12.821692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819540+0000","last_change":"2024-06-13T11:37:12.061010+0000","last_active":"2024-06-13T11:37:12.819540+0000","last_peered":"2024-06-13T11:37:12.819540+0000","last_clean":"2024-06-13T11:37:12.819540+0000","last_became_active":"2024-06-13T11:37:12.059153+0000","last_became_peered":"2024-06-13T11:37:12.059153+0000","last_unstale":"2024-06-13T11:37:12.819540+0000","last_undegraded":"2024-06-13T11:37:12.819540+0000","last_fullsized":"2024-06-13T11:37:12.819540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:51.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714310+0000","last_change":"2024-06-13T11:37:07.813451+0000","last_active":"2024-06-13T11:37:13.714310+0000","last_peered":"2024-06-13T11:37:13.714310+0000","last_clean":"2024-06-13T11:37:13.714310+0000","last_became_active":"2024-06-13T11:37:07.813139+0000","last_became_peered":"2024-06-13T11:37:07.813139+0000","last_unstale":"2024-06-13T11:37:13.714310+0000","last_undegraded":"2024-06-13T11:37:13.714310+0000","last_fullsized":"2024-06-13T11:37:13.714310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820425+0000","last_change":"2024-06-13T11:37:06.791276+0000","last_active":"2024-06-13T11:37:12.820425+0000","last_peered":"2024-06-13T11:37:12.820425+0000","last_clean":"2024-06-13T11:37:12.820425+0000","last_became_active":"2024-06-13T11:37:06.790984+0000","last_became_peered":"2024-06-13T11:37:06.790984+0000","last_unstale":"2024-06-13T11:37:12.820425+0000","last_undegraded":"2024-06-13T11:37:12.820425+0000","last_fullsized":"2024-06-13T11:37:12.820425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712213+0000","last_change":"2024-06-13T11:37:12.056185+0000","last_active":"2024-06-13T11:37:13.712213+0000","last_peered":"2024-06-13T11:37:13.712213+0000","last_clean":"2024-06-13T11:37:13.712213+0000","last_became_active":"2024-06-13T11:37:12.055801+0000","last_became_peered":"2024-06-13T11:37:12.055801+0000","last_unstale":"2024-06-13T11:37:13.712213+0000","last_undegraded":"2024-06-13T11:37:13.712213+0000","last_fullsized":"2024-06-13T11:37:13.712213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:48:35.821250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820132+0000","last_change":"2024-06-13T11:37:07.806070+0000","last_active":"2024-06-13T11:37:12.820132+0000","last_peered":"2024-06-13T11:37:12.820132+0000","last_clean":"2024-06-13T11:37:12.820132+0000","last_became_active":"2024-06-13T11:37:07.805709+0000","last_became_peered":"2024-06-13T11:37:07.805709+0000","last_unstale":"2024-06-13T11:37:12.820132+0000","last_undegraded":"2024-06-13T11:37:12.820132+0000","last_fullsized":"2024-06-13T11:37:12.820132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153136+0000","last_change":"2024-06-13T11:37:06.802281+0000","last_active":"2024-06-13T11:37:13.153136+0000","last_peered":"2024-06-13T11:37:13.153136+0000","last_clean":"2024-06-13T11:37:13.153136+0000","last_became_active":"2024-06-13T11:37:06.801980+0000","last_became_peered":"2024-06-13T11:37:06.801980+0000","last_unstale":"2024-06-13T11:37:13.153136+0000","last_undegraded":"2024-06-13T11:37:13.153136+0000","last_fullsized":"2024-06-13T11:37:13.153136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:12.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713126+0000","last_change":"2024-06-13T11:37:12.058285+0000","last_active":"2024-06-13T11:37:13.713126+0000","last_peered":"2024-06-13T11:37:13.713126+0000","last_clean":"2024-06-13T11:37:13.713126+0000","last_became_active":"2024-06-13T11:37:12.056488+0000","last_became_peered":"2024-06-13T11:37:12.056488+0000","last_unstale":"2024-06-13T11:37:13.713126+0000","last_undegraded":"2024-06-13T11:37:13.713126+0000","last_fullsized":"2024-06-13T11:37:13.713126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168770+0000","last_change":"2024-06-13T11:37:07.819314+0000","last_active":"2024-06-13T11:37:13.168770+0000","last_peered":"2024-06-13T11:37:13.168770+0000","last_clean":"2024-06-13T11:37:13.168770+0000","last_became_active":"2024-06-13T11:37:07.819030+0000","last_became_peered":"2024-06-13T11:37:07.819030+0000","last_unstale":"2024-06-13T11:37:13.168770+0000","last_undegraded":"2024-06-13T11:37:13.168770+0000","last_fullsized":"2024-06-13T11:37:13.168770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820299+0000","last_change":"2024-06-13T11:37:06.793665+0000","last_active":"2024-06-13T11:37:12.820299+0000","last_peered":"2024-06-13T11:37:12.820299+0000","last_clean":"2024-06-13T11:37:12.820299+0000","last_became_active":"2024-06-13T11:37:06.793369+0000","last_became_peered":"2024-06-13T11:37:06.793369+0000","last_unstale":"2024-06-13T11:37:12.820299+0000","last_undegraded":"2024-06-13T11:37:12.820299+0000","last_fullsized":"2024-06-13T11:37:12.820299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819444+0000","last_change":"2024-06-13T11:37:11.840712+0000","last_active":"2024-06-13T11:37:12.819444+0000","last_peered":"2024-06-13T11:37:12.819444+0000","last_clean":"2024-06-13T11:37:12.819444+0000","last_became_active":"2024-06-13T11:37:11.840256+0000","last_became_peered":"2024-06-13T11:37:11.840256+0000","last_unstale":"2024-06-13T11:37:12.819444+0000","last_undegraded":"2024-06-13T11:37:12.819444+0000","last_fullsized":"2024-06-13T11:37:12.819444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820268+0000","last_change":"2024-06-13T11:37:07.814284+0000","last_active":"2024-06-13T11:37:12.820268+0000","last_peered":"2024-06-13T11:37:12.820268+0000","last_clean":"2024-06-13T11:37:12.820268+0000","last_became_active":"2024-06-13T11:37:07.813867+0000","last_became_peered":"2024-06-13T11:37:07.813867+0000","last_unstale":"2024-06-13T11:37:12.820268+0000","last_undegraded":"2024-06-13T11:37:12.820268+0000","last_fullsized":"2024-06-13T11:37:12.820268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:31.198317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168467+0000","last_change":"2024-06-13T11:37:06.805668+0000","last_active":"2024-06-13T11:37:13.168467+0000","last_peered":"2024-06-13T11:37:13.168467+0000","last_clean":"2024-06-13T11:37:13.168467+0000","last_became_active":"2024-06-13T11:37:06.803111+0000","last_became_peered":"2024-06-13T11:37:06.803111+0000","last_unstale":"2024-06-13T11:37:13.168467+0000","last_undegraded":"2024-06-13T11:37:13.168467+0000","last_fullsized":"2024-06-13T11:37:13.168467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820285+0000","last_change":"2024-06-13T11:37:11.841192+0000","last_active":"2024-06-13T11:37:12.820285+0000","last_peered":"2024-06-13T11:37:12.820285+0000","last_clean":"2024-06-13T11:37:12.820285+0000","last_became_active":"2024-06-13T11:37:11.840770+0000","last_became_peered":"2024-06-13T11:37:11.840770+0000","last_unstale":"2024-06-13T11:37:12.820285+0000","last_undegraded":"2024-06-13T11:37:12.820285+0000","last_fullsized":"2024-06-13T11:37:12.820285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819312+0000","last_change":"2024-06-13T11:37:07.806798+0000","last_active":"2024-06-13T11:37:12.819312+0000","last_peered":"2024-06-13T11:37:12.819312+0000","last_clean":"2024-06-13T11:37:12.819312+0000","last_became_active":"2024-06-13T11:37:07.806493+0000","last_became_peered":"2024-06-13T11:37:07.806493+0000","last_unstale":"2024-06-13T11:37:12.819312+0000","last_undegraded":"2024-06-13T11:37:12.819312+0000","last_fullsized":"2024-06-13T11:37:12.819312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712371+0000","last_change":"2024-06-13T11:37:06.797307+0000","last_active":"2024-06-13T11:37:13.712371+0000","last_peered":"2024-06-13T11:37:13.712371+0000","last_clean":"2024-06-13T11:37:13.712371+0000","last_became_active":"2024-06-13T11:37:06.796897+0000","last_became_peered":"2024-06-13T11:37:06.796897+0000","last_unstale":"2024-06-13T11:37:13.712371+0000","last_undegraded":"2024-06-13T11:37:13.712371+0000","last_fullsized":"2024-06-13T11:37:13.712371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820560+0000","last_change":"2024-06-13T11:37:11.842116+0000","last_active":"2024-06-13T11:37:12.820560+0000","last_peered":"2024-06-13T11:37:12.820560+0000","last_clean":"2024-06-13T11:37:12.820560+0000","last_became_active":"2024-06-13T11:37:11.841597+0000","last_became_peered":"2024-06-13T11:37:11.841597+0000","last_unstale":"2024-06-13T11:37:12.820560+0000","last_undegraded":"2024-06-13T11:37:12.820560+0000","last_fullsized":"2024-06-13T11:37:12.820560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712832+0000","last_change":"2024-06-13T11:37:07.808451+0000","last_active":"2024-06-13T11:37:13.712832+0000","last_peered":"2024-06-13T11:37:13.712832+0000","last_clean":"2024-06-13T11:37:13.712832+0000","last_became_active":"2024-06-13T11:37:07.808158+0000","last_became_peered":"2024-06-13T11:37:07.808158+0000","last_unstale":"2024-06-13T11:37:13.712832+0000","last_undegraded":"2024-06-13T11:37:13.712832+0000","last_fullsized":"2024-06-13T11:37:13.712832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:06:11.057302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152421+0000","last_change":"2024-06-13T11:37:06.804573+0000","last_active":"2024-06-13T11:37:13.152421+0000","last_peered":"2024-06-13T11:37:13.152421+0000","last_clean":"2024-06-13T11:37:13.152421+0000","last_became_active":"2024-06-13T11:37:06.804222+0000","last_became_peered":"2024-06-13T11:37:06.804222+0000","last_unstale":"2024-06-13T11:37:13.152421+0000","last_undegraded":"2024-06-13T11:37:13.152421+0000","last_fullsized":"2024-06-13T11:37:13.152421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:32.931150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713243+0000","last_change":"2024-06-13T11:37:12.057907+0000","last_active":"2024-06-13T11:37:13.713243+0000","last_peered":"2024-06-13T11:37:13.713243+0000","last_clean":"2024-06-13T11:37:13.713243+0000","last_became_active":"2024-06-13T11:37:12.056975+0000","last_became_peered":"2024-06-13T11:37:12.056975+0000","last_unstale":"2024-06-13T11:37:13.713243+0000","last_undegraded":"2024-06-13T11:37:13.713243+0000","last_fullsized":"2024-06-13T11:37:13.713243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713310+0000","last_change":"2024-06-13T11:37:07.812853+0000","last_active":"2024-06-13T11:37:13.713310+0000","last_peered":"2024-06-13T11:37:13.713310+0000","last_clean":"2024-06-13T11:37:13.713310+0000","last_became_active":"2024-06-13T11:37:07.812292+0000","last_became_peered":"2024-06-13T11:37:07.812292+0000","last_unstale":"2024-06-13T11:37:13.713310+0000","last_undegraded":"2024-06-13T11:37:13.713310+0000","last_fullsized":"2024-06-13T11:37:13.713310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:22.022588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168381+0000","last_change":"2024-06-13T11:37:06.801964+0000","last_active":"2024-06-13T11:37:13.168381+0000","last_peered":"2024-06-13T11:37:13.168381+0000","last_clean":"2024-06-13T11:37:13.168381+0000","last_became_active":"2024-06-13T11:37:06.801593+0000","last_became_peered":"2024-06-13T11:37:06.801593+0000","last_unstale":"2024-06-13T11:37:13.168381+0000","last_undegraded":"2024-06-13T11:37:13.168381+0000","last_fullsized":"2024-06-13T11:37:13.168381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152564+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:13.152564+0000","last_peered":"2024-06-13T11:37:13.152564+0000","last_clean":"2024-06-13T11:37:13.152564+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:13.152564+0000","last_undegraded":"2024-06-13T11:37:13.152564+0000","last_fullsized":"2024-06-13T11:37:13.152564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821546+0000","last_change":"2024-06-13T11:37:12.059771+0000","last_active":"2024-06-13T11:37:12.821546+0000","last_peered":"2024-06-13T11:37:12.821546+0000","last_clean":"2024-06-13T11:37:12.821546+0000","last_became_active":"2024-06-13T11:37:12.059321+0000","last_became_peered":"2024-06-13T11:37:12.059321+0000","last_unstale":"2024-06-13T11:37:12.821546+0000","last_undegraded":"2024-06-13T11:37:12.821546+0000","last_fullsized":"2024-06-13T11:37:12.821546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152859+0000","last_change":"2024-06-13T11:37:07.811589+0000","last_active":"2024-06-13T11:37:13.152859+0000","last_peered":"2024-06-13T11:37:13.152859+0000","last_clean":"2024-06-13T11:37:13.152859+0000","last_became_active":"2024-06-13T11:37:07.809978+0000","last_became_peered":"2024-06-13T11:37:07.809978+0000","last_unstale":"2024-06-13T11:37:13.152859+0000","last_undegraded":"2024-06-13T11:37:13.152859+0000","last_fullsized":"2024-06-13T11:37:13.152859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713015+0000","last_change":"2024-06-13T11:37:06.803922+0000","last_active":"2024-06-13T11:37:13.713015+0000","last_peered":"2024-06-13T11:37:13.713015+0000","last_clean":"2024-06-13T11:37:13.713015+0000","last_became_active":"2024-06-13T11:37:06.803580+0000","last_became_peered":"2024-06-13T11:37:06.803580+0000","last_unstale":"2024-06-13T11:37:13.713015+0000","last_undegraded":"2024-06-13T11:37:13.713015+0000","last_fullsized":"2024-06-13T11:37:13.713015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820954+0000","last_change":"2024-06-13T11:37:12.057052+0000","last_active":"2024-06-13T11:37:12.820954+0000","last_peered":"2024-06-13T11:37:12.820954+0000","last_clean":"2024-06-13T11:37:12.820954+0000","last_became_active":"2024-06-13T11:37:12.056584+0000","last_became_peered":"2024-06-13T11:37:12.056584+0000","last_unstale":"2024-06-13T11:37:12.820954+0000","last_undegraded":"2024-06-13T11:37:12.820954+0000","last_fullsized":"2024-06-13T11:37:12.820954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168499+0000","last_change":"2024-06-13T11:37:07.812006+0000","last_active":"2024-06-13T11:37:13.168499+0000","last_peered":"2024-06-13T11:37:13.168499+0000","last_clean":"2024-06-13T11:37:13.168499+0000","last_became_active":"2024-06-13T11:37:07.811291+0000","last_became_peered":"2024-06-13T11:37:07.811291+0000","last_unstale":"2024-06-13T11:37:13.168499+0000","last_undegraded":"2024-06-13T11:37:13.168499+0000","last_fullsized":"2024-06-13T11:37:13.168499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820081+0000","last_change":"2024-06-13T11:37:06.795354+0000","last_active":"2024-06-13T11:37:12.820081+0000","last_peered":"2024-06-13T11:37:12.820081+0000","last_clean":"2024-06-13T11:37:12.820081+0000","last_became_active":"2024-06-13T11:37:06.795061+0000","last_became_peered":"2024-06-13T11:37:06.795061+0000","last_unstale":"2024-06-13T11:37:12.820081+0000","last_undegraded":"2024-06-13T11:37:12.820081+0000","last_fullsized":"2024-06-13T11:37:12.820081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:03.016226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713370+0000","last_change":"2024-06-13T11:37:11.837119+0000","last_active":"2024-06-13T11:37:13.713370+0000","last_peered":"2024-06-13T11:37:13.713370+0000","last_clean":"2024-06-13T11:37:13.713370+0000","last_became_active":"2024-06-13T11:37:11.835585+0000","last_became_peered":"2024-06-13T11:37:11.835585+0000","last_unstale":"2024-06-13T11:37:13.713370+0000","last_undegraded":"2024-06-13T11:37:13.713370+0000","last_fullsized":"2024-06-13T11:37:13.713370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153245+0000","last_change":"2024-06-13T11:37:07.824375+0000","last_active":"2024-06-13T11:37:13.153245+0000","last_peered":"2024-06-13T11:37:13.153245+0000","last_clean":"2024-06-13T11:37:13.153245+0000","last_became_active":"2024-06-13T11:37:07.823632+0000","last_became_peered":"2024-06-13T11:37:07.823632+0000","last_unstale":"2024-06-13T11:37:13.153245+0000","last_undegraded":"2024-06-13T11:37:13.153245+0000","last_fullsized":"2024-06-13T11:37:13.153245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:31:03.309590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712454+0000","last_change":"2024-06-13T11:37:06.795631+0000","last_active":"2024-06-13T11:37:13.712454+0000","last_peered":"2024-06-13T11:37:13.712454+0000","last_clean":"2024-06-13T11:37:13.712454+0000","last_became_active":"2024-06-13T11:37:06.795324+0000","last_became_peered":"2024-06-13T11:37:06.795324+0000","last_unstale":"2024-06-13T11:37:13.712454+0000","last_undegraded":"2024-06-13T11:37:13.712454+0000","last_fullsized":"2024-06-13T11:37:13.712454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168005+0000","last_change":"2024-06-13T11:37:12.057488+0000","last_active":"2024-06-13T11:37:13.168005+0000","last_peered":"2024-06-13T11:37:13.168005+0000","last_clean":"2024-06-13T11:37:13.168005+0000","last_became_active":"2024-06-13T11:37:12.055585+0000","last_became_peered":"2024-06-13T11:37:12.055585+0000","last_unstale":"2024-06-13T11:37:13.168005+0000","last_undegraded":"2024-06-13T11:37:13.168005+0000","last_fullsized":"2024-06-13T11:37:13.168005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:50:00.925587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153108+0000","last_change":"2024-06-13T11:37:07.820932+0000","last_active":"2024-06-13T11:37:13.153108+0000","last_peered":"2024-06-13T11:37:13.153108+0000","last_clean":"2024-06-13T11:37:13.153108+0000","last_became_active":"2024-06-13T11:37:07.820617+0000","last_became_peered":"2024-06-13T11:37:07.820617+0000","last_unstale":"2024-06-13T11:37:13.153108+0000","last_undegraded":"2024-06-13T11:37:13.153108+0000","last_fullsized":"2024-06-13T11:37:13.153108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821493+0000","last_change":"2024-06-13T11:37:06.794223+0000","last_active":"2024-06-13T11:37:12.821493+0000","last_peered":"2024-06-13T11:37:12.821493+0000","last_clean":"2024-06-13T11:37:12.821493+0000","last_became_active":"2024-06-13T11:37:06.793864+0000","last_became_peered":"2024-06-13T11:37:06.793864+0000","last_unstale":"2024-06-13T11:37:12.821493+0000","last_undegraded":"2024-06-13T11:37:12.821493+0000","last_fullsized":"2024-06-13T11:37:12.821493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819177+0000","last_change":"2024-06-13T11:37:11.840914+0000","last_active":"2024-06-13T11:37:12.819177+0000","last_peered":"2024-06-13T11:37:12.819177+0000","last_clean":"2024-06-13T11:37:12.819177+0000","last_became_active":"2024-06-13T11:37:11.840526+0000","last_became_peered":"2024-06-13T11:37:11.840526+0000","last_unstale":"2024-06-13T11:37:12.819177+0000","last_undegraded":"2024-06-13T11:37:12.819177+0000","last_fullsized":"2024-06-13T11:37:12.819177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:43.551508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152587+0000","last_change":"2024-06-13T11:37:07.822417+0000","last_active":"2024-06-13T11:37:13.152587+0000","last_peered":"2024-06-13T11:37:13.152587+0000","last_clean":"2024-06-13T11:37:13.152587+0000","last_became_active":"2024-06-13T11:37:07.822089+0000","last_became_peered":"2024-06-13T11:37:07.822089+0000","last_unstale":"2024-06-13T11:37:13.152587+0000","last_undegraded":"2024-06-13T11:37:13.152587+0000","last_fullsized":"2024-06-13T11:37:13.152587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712075+0000","last_change":"2024-06-13T11:37:06.785156+0000","last_active":"2024-06-13T11:37:13.712075+0000","last_peered":"2024-06-13T11:37:13.712075+0000","last_clean":"2024-06-13T11:37:13.712075+0000","last_became_active":"2024-06-13T11:37:06.784829+0000","last_became_peered":"2024-06-13T11:37:06.784829+0000","last_unstale":"2024-06-13T11:37:13.712075+0000","last_undegraded":"2024-06-13T11:37:13.712075+0000","last_fullsized":"2024-06-13T11:37:13.712075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712893+0000","last_change":"2024-06-13T11:37:11.838670+0000","last_active":"2024-06-13T11:37:13.712893+0000","last_peered":"2024-06-13T11:37:13.712893+0000","last_clean":"2024-06-13T11:37:13.712893+0000","last_became_active":"2024-06-13T11:37:11.838262+0000","last_became_peered":"2024-06-13T11:37:11.838262+0000","last_unstale":"2024-06-13T11:37:13.712893+0000","last_undegraded":"2024-06-13T11:37:13.712893+0000","last_fullsized":"2024-06-13T11:37:13.712893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:17.899945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820178+0000","last_change":"2024-06-13T11:37:07.816286+0000","last_active":"2024-06-13T11:37:12.820178+0000","last_peered":"2024-06-13T11:37:12.820178+0000","last_clean":"2024-06-13T11:37:12.820178+0000","last_became_active":"2024-06-13T11:37:07.815777+0000","last_became_peered":"2024-06-13T11:37:07.815777+0000","last_unstale":"2024-06-13T11:37:12.820178+0000","last_undegraded":"2024-06-13T11:37:12.820178+0000","last_fullsized":"2024-06-13T11:37:12.820178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820785+0000","last_change":"2024-06-13T11:37:06.789763+0000","last_active":"2024-06-13T11:37:12.820785+0000","last_peered":"2024-06-13T11:37:12.820785+0000","last_clean":"2024-06-13T11:37:12.820785+0000","last_became_active":"2024-06-13T11:37:06.789419+0000","last_became_peered":"2024-06-13T11:37:06.789419+0000","last_unstale":"2024-06-13T11:37:12.820785+0000","last_undegraded":"2024-06-13T11:37:12.820785+0000","last_fullsized":"2024-06-13T11:37:12.820785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714261+0000","last_change":"2024-06-13T11:37:12.059420+0000","last_active":"2024-06-13T11:37:13.714261+0000","last_peered":"2024-06-13T11:37:13.714261+0000","last_clean":"2024-06-13T11:37:13.714261+0000","last_became_active":"2024-06-13T11:37:12.059035+0000","last_became_peered":"2024-06-13T11:37:12.059035+0000","last_unstale":"2024-06-13T11:37:13.714261+0000","last_undegraded":"2024-06-13T11:37:13.714261+0000","last_fullsized":"2024-06-13T11:37:13.714261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:47:04.312331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152626+0000","last_change":"2024-06-13T11:37:07.823057+0000","last_active":"2024-06-13T11:37:13.152626+0000","last_peered":"2024-06-13T11:37:13.152626+0000","last_clean":"2024-06-13T11:37:13.152626+0000","last_became_active":"2024-06-13T11:37:07.821414+0000","last_became_peered":"2024-06-13T11:37:07.821414+0000","last_unstale":"2024-06-13T11:37:13.152626+0000","last_undegraded":"2024-06-13T11:37:13.152626+0000","last_fullsized":"2024-06-13T11:37:13.152626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168391+0000","last_change":"2024-06-13T11:37:06.805846+0000","last_active":"2024-06-13T11:37:13.168391+0000","last_peered":"2024-06-13T11:37:13.168391+0000","last_clean":"2024-06-13T11:37:13.168391+0000","last_became_active":"2024-06-13T11:37:06.803100+0000","last_became_peered":"2024-06-13T11:37:06.803100+0000","last_unstale":"2024-06-13T11:37:13.168391+0000","last_undegraded":"2024-06-13T11:37:13.168391+0000","last_fullsized":"2024-06-13T11:37:13.168391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:36.725938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714058+0000","last_change":"2024-06-13T11:37:12.055700+0000","last_active":"2024-06-13T11:37:13.714058+0000","last_peered":"2024-06-13T11:37:13.714058+0000","last_clean":"2024-06-13T11:37:13.714058+0000","last_became_active":"2024-06-13T11:37:12.055159+0000","last_became_peered":"2024-06-13T11:37:12.055159+0000","last_unstale":"2024-06-13T11:37:13.714058+0000","last_undegraded":"2024-06-13T11:37:13.714058+0000","last_fullsized":"2024-06-13T11:37:13.714058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:55:00.012631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713171+0000","last_change":"2024-06-13T11:37:07.806718+0000","last_active":"2024-06-13T11:37:13.713171+0000","last_peered":"2024-06-13T11:37:13.713171+0000","last_clean":"2024-06-13T11:37:13.713171+0000","last_became_active":"2024-06-13T11:37:07.806243+0000","last_became_peered":"2024-06-13T11:37:07.806243+0000","last_unstale":"2024-06-13T11:37:13.713171+0000","last_undegraded":"2024-06-13T11:37:13.713171+0000","last_fullsized":"2024-06-13T11:37:13.713171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:44:45.438582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713668+0000","last_change":"2024-06-13T11:37:06.798091+0000","last_active":"2024-06-13T11:37:13.713668+0000","last_peered":"2024-06-13T11:37:13.713668+0000","last_clean":"2024-06-13T11:37:13.713668+0000","last_became_active":"2024-06-13T11:37:06.797712+0000","last_became_peered":"2024-06-13T11:37:06.797712+0000","last_unstale":"2024-06-13T11:37:13.713668+0000","last_undegraded":"2024-06-13T11:37:13.713668+0000","last_fullsized":"2024-06-13T11:37:13.713668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168678+0000","last_change":"2024-06-13T11:37:12.056862+0000","last_active":"2024-06-13T11:37:13.168678+0000","last_peered":"2024-06-13T11:37:13.168678+0000","last_clean":"2024-06-13T11:37:13.168678+0000","last_became_active":"2024-06-13T11:37:12.056394+0000","last_became_peered":"2024-06-13T11:37:12.056394+0000","last_unstale":"2024-06-13T11:37:13.168678+0000","last_undegraded":"2024-06-13T11:37:13.168678+0000","last_fullsized":"2024-06-13T11:37:13.168678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:30:32.045207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152808+0000","last_change":"2024-06-13T11:37:07.816795+0000","last_active":"2024-06-13T11:37:13.152808+0000","last_peered":"2024-06-13T11:37:13.152808+0000","last_clean":"2024-06-13T11:37:13.152808+0000","last_became_active":"2024-06-13T11:37:07.816480+0000","last_became_peered":"2024-06-13T11:37:07.816480+0000","last_unstale":"2024-06-13T11:37:13.152808+0000","last_undegraded":"2024-06-13T11:37:13.152808+0000","last_fullsized":"2024-06-13T11:37:13.152808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:17.399783+0000","last_change":"2024-06-13T11:37:06.793664+0000","last_active":"2024-06-13T11:37:17.399783+0000","last_peered":"2024-06-13T11:37:17.399783+0000","last_clean":"2024-06-13T11:37:17.399783+0000","last_became_active":"2024-06-13T11:37:06.793399+0000","last_became_peered":"2024-06-13T11:37:06.793399+0000","last_unstale":"2024-06-13T11:37:17.399783+0000","last_undegraded":"2024-06-13T11:37:17.399783+0000","last_fullsized":"2024-06-13T11:37:17.399783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819864+0000","last_change":"2024-06-13T11:37:11.840940+0000","last_active":"2024-06-13T11:37:12.819864+0000","last_peered":"2024-06-13T11:37:12.819864+0000","last_clean":"2024-06-13T11:37:12.819864+0000","last_became_active":"2024-06-13T11:37:11.840527+0000","last_became_peered":"2024-06-13T11:37:11.840527+0000","last_unstale":"2024-06-13T11:37:12.819864+0000","last_undegraded":"2024-06-13T11:37:12.819864+0000","last_fullsized":"2024-06-13T11:37:12.819864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821244+0000","last_change":"2024-06-13T11:37:07.810016+0000","last_active":"2024-06-13T11:37:12.821244+0000","last_peered":"2024-06-13T11:37:12.821244+0000","last_clean":"2024-06-13T11:37:12.821244+0000","last_became_active":"2024-06-13T11:37:07.809754+0000","last_became_peered":"2024-06-13T11:37:07.809754+0000","last_unstale":"2024-06-13T11:37:12.821244+0000","last_undegraded":"2024-06-13T11:37:12.821244+0000","last_fullsized":"2024-06-13T11:37:12.821244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:13.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820199+0000","last_change":"2024-06-13T11:37:06.802832+0000","last_active":"2024-06-13T11:37:12.820199+0000","last_peered":"2024-06-13T11:37:12.820199+0000","last_clean":"2024-06-13T11:37:12.820199+0000","last_became_active":"2024-06-13T11:37:06.802502+0000","last_became_peered":"2024-06-13T11:37:06.802502+0000","last_unstale":"2024-06-13T11:37:12.820199+0000","last_undegraded":"2024-06-13T11:37:12.820199+0000","last_fullsized":"2024-06-13T11:37:12.820199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819861+0000","last_change":"2024-06-13T11:37:11.842063+0000","last_active":"2024-06-13T11:37:12.819861+0000","last_peered":"2024-06-13T11:37:12.819861+0000","last_clean":"2024-06-13T11:37:12.819861+0000","last_became_active":"2024-06-13T11:37:11.841560+0000","last_became_peered":"2024-06-13T11:37:11.841560+0000","last_unstale":"2024-06-13T11:37:12.819861+0000","last_undegraded":"2024-06-13T11:37:12.819861+0000","last_fullsized":"2024-06-13T11:37:12.819861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:51.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713089+0000","last_change":"2024-06-13T11:37:07.816725+0000","last_active":"2024-06-13T11:37:13.713089+0000","last_peered":"2024-06-13T11:37:13.713089+0000","last_clean":"2024-06-13T11:37:13.713089+0000","last_became_active":"2024-06-13T11:37:07.816381+0000","last_became_peered":"2024-06-13T11:37:07.816381+0000","last_unstale":"2024-06-13T11:37:13.713089+0000","last_undegraded":"2024-06-13T11:37:13.713089+0000","last_fullsized":"2024-06-13T11:37:13.713089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168737+0000","last_change":"2024-06-13T11:37:06.804917+0000","last_active":"2024-06-13T11:37:13.168737+0000","last_peered":"2024-06-13T11:37:13.168737+0000","last_clean":"2024-06-13T11:37:13.168737+0000","last_became_active":"2024-06-13T11:37:06.804193+0000","last_became_peered":"2024-06-13T11:37:06.804193+0000","last_unstale":"2024-06-13T11:37:13.168737+0000","last_undegraded":"2024-06-13T11:37:13.168737+0000","last_fullsized":"2024-06-13T11:37:13.168737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:28.538858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712516+0000","last_change":"2024-06-13T11:37:11.842840+0000","last_active":"2024-06-13T11:37:13.712516+0000","last_peered":"2024-06-13T11:37:13.712516+0000","last_clean":"2024-06-13T11:37:13.712516+0000","last_became_active":"2024-06-13T11:37:11.842012+0000","last_became_peered":"2024-06-13T11:37:11.842012+0000","last_unstale":"2024-06-13T11:37:13.712516+0000","last_undegraded":"2024-06-13T11:37:13.712516+0000","last_fullsized":"2024-06-13T11:37:13.712516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:55.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168668+0000","last_change":"2024-06-13T11:37:07.814121+0000","last_active":"2024-06-13T11:37:13.168668+0000","last_peered":"2024-06-13T11:37:13.168668+0000","last_clean":"2024-06-13T11:37:13.168668+0000","last_became_active":"2024-06-13T11:37:07.813843+0000","last_became_peered":"2024-06-13T11:37:07.813843+0000","last_unstale":"2024-06-13T11:37:13.168668+0000","last_undegraded":"2024-06-13T11:37:13.168668+0000","last_fullsized":"2024-06-13T11:37:13.168668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821122+0000","last_change":"2024-06-13T11:37:06.803877+0000","last_active":"2024-06-13T11:37:12.821122+0000","last_peered":"2024-06-13T11:37:12.821122+0000","last_clean":"2024-06-13T11:37:12.821122+0000","last_became_active":"2024-06-13T11:37:06.803562+0000","last_became_peered":"2024-06-13T11:37:06.803562+0000","last_unstale":"2024-06-13T11:37:12.821122+0000","last_undegraded":"2024-06-13T11:37:12.821122+0000","last_fullsized":"2024-06-13T11:37:12.821122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713551+0000","last_change":"2024-06-13T11:37:12.055863+0000","last_active":"2024-06-13T11:37:13.713551+0000","last_peered":"2024-06-13T11:37:13.713551+0000","last_clean":"2024-06-13T11:37:13.713551+0000","last_became_active":"2024-06-13T11:37:12.055240+0000","last_became_peered":"2024-06-13T11:37:12.055240+0000","last_unstale":"2024-06-13T11:37:13.713551+0000","last_undegraded":"2024-06-13T11:37:13.713551+0000","last_fullsized":"2024-06-13T11:37:13.713551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:00.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712723+0000","last_change":"2024-06-13T11:37:12.059446+0000","last_active":"2024-06-13T11:37:13.712723+0000","last_peered":"2024-06-13T11:37:13.712723+0000","last_clean":"2024-06-13T11:37:13.712723+0000","last_became_active":"2024-06-13T11:37:12.057697+0000","last_became_peered":"2024-06-13T11:37:12.057697+0000","last_unstale":"2024-06-13T11:37:13.712723+0000","last_undegraded":"2024-06-13T11:37:13.712723+0000","last_fullsized":"2024-06-13T11:37:13.712723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819164+0000","last_change":"2024-06-13T11:37:07.814989+0000","last_active":"2024-06-13T11:37:12.819164+0000","last_peered":"2024-06-13T11:37:12.819164+0000","last_clean":"2024-06-13T11:37:12.819164+0000","last_became_active":"2024-06-13T11:37:07.814564+0000","last_became_peered":"2024-06-13T11:37:07.814564+0000","last_unstale":"2024-06-13T11:37:12.819164+0000","last_undegraded":"2024-06-13T11:37:12.819164+0000","last_fullsized":"2024-06-13T11:37:12.819164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168310+0000","last_change":"2024-06-13T11:37:06.802741+0000","last_active":"2024-06-13T11:37:13.168310+0000","last_peered":"2024-06-13T11:37:13.168310+0000","last_clean":"2024-06-13T11:37:13.168310+0000","last_became_active":"2024-06-13T11:37:06.802409+0000","last_became_peered":"2024-06-13T11:37:06.802409+0000","last_unstale":"2024-06-13T11:37:13.168310+0000","last_undegraded":"2024-06-13T11:37:13.168310+0000","last_fullsized":"2024-06-13T11:37:13.168310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:05:54.761290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819943+0000","last_change":"2024-06-13T11:37:11.841003+0000","last_active":"2024-06-13T11:37:12.819943+0000","last_peered":"2024-06-13T11:37:12.819943+0000","last_clean":"2024-06-13T11:37:12.819943+0000","last_became_active":"2024-06-13T11:37:11.840537+0000","last_became_peered":"2024-06-13T11:37:11.840537+0000","last_unstale":"2024-06-13T11:37:12.819943+0000","last_undegraded":"2024-06-13T11:37:12.819943+0000","last_fullsized":"2024-06-13T11:37:12.819943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:16:14.249413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712613+0000","last_change":"2024-06-13T11:37:07.814236+0000","last_active":"2024-06-13T11:37:13.712613+0000","last_peered":"2024-06-13T11:37:13.712613+0000","last_clean":"2024-06-13T11:37:13.712613+0000","last_became_active":"2024-06-13T11:37:07.813951+0000","last_became_peered":"2024-06-13T11:37:07.813951+0000","last_unstale":"2024-06-13T11:37:13.712613+0000","last_undegraded":"2024-06-13T11:37:13.712613+0000","last_fullsized":"2024-06-13T11:37:13.712613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713871+0000","last_change":"2024-06-13T11:37:06.793599+0000","last_active":"2024-06-13T11:37:13.713871+0000","last_peered":"2024-06-13T11:37:13.713871+0000","last_clean":"2024-06-13T11:37:13.713871+0000","last_became_active":"2024-06-13T11:37:06.793280+0000","last_became_peered":"2024-06-13T11:37:06.793280+0000","last_unstale":"2024-06-13T11:37:13.713871+0000","last_undegraded":"2024-06-13T11:37:13.713871+0000","last_fullsized":"2024-06-13T11:37:13.713871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821282+0000","last_change":"2024-06-13T11:37:06.794432+0000","last_active":"2024-06-13T11:37:12.821282+0000","last_peered":"2024-06-13T11:37:12.821282+0000","last_clean":"2024-06-13T11:37:12.821282+0000","last_became_active":"2024-06-13T11:37:06.794119+0000","last_became_peered":"2024-06-13T11:37:06.794119+0000","last_unstale":"2024-06-13T11:37:12.821282+0000","last_undegraded":"2024-06-13T11:37:12.821282+0000","last_fullsized":"2024-06-13T11:37:12.821282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713576+0000","last_change":"2024-06-13T11:37:07.809910+0000","last_active":"2024-06-13T11:37:13.713576+0000","last_peered":"2024-06-13T11:37:13.713576+0000","last_clean":"2024-06-13T11:37:13.713576+0000","last_became_active":"2024-06-13T11:37:07.809587+0000","last_became_peered":"2024-06-13T11:37:07.809587+0000","last_unstale":"2024-06-13T11:37:13.713576+0000","last_undegraded":"2024-06-13T11:37:13.713576+0000","last_fullsized":"2024-06-13T11:37:13.713576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712785+0000","last_change":"2024-06-13T11:37:11.832051+0000","last_active":"2024-06-13T11:37:13.712785+0000","last_peered":"2024-06-13T11:37:13.712785+0000","last_clean":"2024-06-13T11:37:13.712785+0000","last_became_active":"2024-06-13T11:37:11.831633+0000","last_became_peered":"2024-06-13T11:37:11.831633+0000","last_unstale":"2024-06-13T11:37:13.712785+0000","last_undegraded":"2024-06-13T11:37:13.712785+0000","last_fullsized":"2024-06-13T11:37:13.712785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:03:22.884367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713873+0000","last_change":"2024-06-13T11:37:06.797052+0000","last_active":"2024-06-13T11:37:13.713873+0000","last_peered":"2024-06-13T11:37:13.713873+0000","last_clean":"2024-06-13T11:37:13.713873+0000","last_became_active":"2024-06-13T11:37:06.796723+0000","last_became_peered":"2024-06-13T11:37:06.796723+0000","last_unstale":"2024-06-13T11:37:13.713873+0000","last_undegraded":"2024-06-13T11:37:13.713873+0000","last_fullsized":"2024-06-13T11:37:13.713873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819596+0000","last_change":"2024-06-13T11:37:07.805771+0000","last_active":"2024-06-13T11:37:12.819596+0000","last_peered":"2024-06-13T11:37:12.819596+0000","last_clean":"2024-06-13T11:37:12.819596+0000","last_became_active":"2024-06-13T11:37:07.805463+0000","last_became_peered":"2024-06-13T11:37:07.805463+0000","last_unstale":"2024-06-13T11:37:12.819596+0000","last_undegraded":"2024-06-13T11:37:12.819596+0000","last_fullsized":"2024-06-13T11:37:12.819596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:44.456986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713722+0000","last_change":"2024-06-13T11:37:11.841035+0000","last_active":"2024-06-13T11:37:13.713722+0000","last_peered":"2024-06-13T11:37:13.713722+0000","last_clean":"2024-06-13T11:37:13.713722+0000","last_became_active":"2024-06-13T11:37:11.840626+0000","last_became_peered":"2024-06-13T11:37:11.840626+0000","last_unstale":"2024-06-13T11:37:13.713722+0000","last_undegraded":"2024-06-13T11:37:13.713722+0000","last_fullsized":"2024-06-13T11:37:13.713722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:32:57.521991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820017+0000","last_change":"2024-06-13T11:37:07.816052+0000","last_active":"2024-06-13T11:37:12.820017+0000","last_peered":"2024-06-13T11:37:12.820017+0000","last_clean":"2024-06-13T11:37:12.820017+0000","last_became_active":"2024-06-13T11:37:07.815407+0000","last_became_peered":"2024-06-13T11:37:07.815407+0000","last_unstale":"2024-06-13T11:37:12.820017+0000","last_undegraded":"2024-06-13T11:37:12.820017+0000","last_fullsized":"2024-06-13T11:37:12.820017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712280+0000","last_change":"2024-06-13T11:37:07.813338+0000","last_active":"2024-06-13T11:37:13.712280+0000","last_peered":"2024-06-13T11:37:13.712280+0000","last_clean":"2024-06-13T11:37:13.712280+0000","last_became_active":"2024-06-13T11:37:07.813058+0000","last_became_peered":"2024-06-13T11:37:07.813058+0000","last_unstale":"2024-06-13T11:37:13.712280+0000","last_undegraded":"2024-06-13T11:37:13.712280+0000","last_fullsized":"2024-06-13T11:37:13.712280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:04.020273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168311+0000","last_change":"2024-06-13T11:37:07.814579+0000","last_active":"2024-06-13T11:37:13.168311+0000","last_peered":"2024-06-13T11:37:13.168311+0000","last_clean":"2024-06-13T11:37:13.168311+0000","last_became_active":"2024-06-13T11:37:07.814287+0000","last_became_peered":"2024-06-13T11:37:07.814287+0000","last_unstale":"2024-06-13T11:37:13.168311+0000","last_undegraded":"2024-06-13T11:37:13.168311+0000","last_fullsized":"2024-06-13T11:37:13.168311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713460+0000","last_change":"2024-06-13T11:37:07.812453+0000","last_active":"2024-06-13T11:37:13.713460+0000","last_peered":"2024-06-13T11:37:13.713460+0000","last_clean":"2024-06-13T11:37:13.713460+0000","last_became_active":"2024-06-13T11:37:07.812179+0000","last_became_peered":"2024-06-13T11:37:07.812179+0000","last_unstale":"2024-06-13T11:37:13.713460+0000","last_undegraded":"2024-06-13T11:37:13.713460+0000","last_fullsized":"2024-06-13T11:37:13.713460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714168+0000","last_change":"2024-06-13T11:37:07.809534+0000","last_active":"2024-06-13T11:37:13.714168+0000","last_peered":"2024-06-13T11:37:13.714168+0000","last_clean":"2024-06-13T11:37:13.714168+0000","last_became_active":"2024-06-13T11:37:07.809238+0000","last_became_peered":"2024-06-13T11:37:07.809238+0000","last_unstale":"2024-06-13T11:37:13.714168+0000","last_undegraded":"2024-06-13T11:37:13.714168+0000","last_fullsized":"2024-06-13T11:37:13.714168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:16:41.866755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819893+0000","last_change":"2024-06-13T11:37:07.818257+0000","last_active":"2024-06-13T11:37:12.819893+0000","last_peered":"2024-06-13T11:37:12.819893+0000","last_clean":"2024-06-13T11:37:12.819893+0000","last_became_active":"2024-06-13T11:37:07.817910+0000","last_became_peered":"2024-06-13T11:37:07.817910+0000","last_unstale":"2024-06-13T11:37:12.819893+0000","last_undegraded":"2024-06-13T11:37:12.819893+0000","last_fullsized":"2024-06-13T11:37:12.819893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821518+0000","last_change":"2024-06-13T11:37:07.810465+0000","last_active":"2024-06-13T11:37:12.821518+0000","last_peered":"2024-06-13T11:37:12.821518+0000","last_clean":"2024-06-13T11:37:12.821518+0000","last_became_active":"2024-06-13T11:37:07.810018+0000","last_became_peered":"2024-06-13T11:37:07.810018+0000","last_unstale":"2024-06-13T11:37:12.821518+0000","last_undegraded":"2024-06-13T11:37:12.821518+0000","last_fullsized":"2024-06-13T11:37:12.821518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714221+0000","last_change":"2024-06-13T11:37:07.807899+0000","last_active":"2024-06-13T11:37:13.714221+0000","last_peered":"2024-06-13T11:37:13.714221+0000","last_clean":"2024-06-13T11:37:13.714221+0000","last_became_active":"2024-06-13T11:37:07.807583+0000","last_became_peered":"2024-06-13T11:37:07.807583+0000","last_unstale":"2024-06-13T11:37:13.714221+0000","last_undegraded":"2024-06-13T11:37:13.714221+0000","last_fullsized":"2024-06-13T11:37:13.714221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:11.241283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168187+0000","last_change":"2024-06-13T11:37:07.803581+0000","last_active":"2024-06-13T11:37:13.168187+0000","last_peered":"2024-06-13T11:37:13.168187+0000","last_clean":"2024-06-13T11:37:13.168187+0000","last_became_active":"2024-06-13T11:37:07.803152+0000","last_became_peered":"2024-06-13T11:37:07.803152+0000","last_unstale":"2024-06-13T11:37:13.168187+0000","last_undegraded":"2024-06-13T11:37:13.168187+0000","last_fullsized":"2024-06-13T11:37:13.168187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713706+0000","last_change":"2024-06-13T11:37:07.805036+0000","last_active":"2024-06-13T11:37:13.713706+0000","last_peered":"2024-06-13T11:37:13.713706+0000","last_clean":"2024-06-13T11:37:13.713706+0000","last_became_active":"2024-06-13T11:37:07.804074+0000","last_became_peered":"2024-06-13T11:37:07.804074+0000","last_unstale":"2024-06-13T11:37:13.713706+0000","last_undegraded":"2024-06-13T11:37:13.713706+0000","last_fullsized":"2024-06-13T11:37:13.713706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:32:19.911394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168271+0000","last_change":"2024-06-13T11:37:07.822794+0000","last_active":"2024-06-13T11:37:13.168271+0000","last_peered":"2024-06-13T11:37:13.168271+0000","last_clean":"2024-06-13T11:37:13.168271+0000","last_became_active":"2024-06-13T11:37:07.822476+0000","last_became_peered":"2024-06-13T11:37:07.822476+0000","last_unstale":"2024-06-13T11:37:13.168271+0000","last_undegraded":"2024-06-13T11:37:13.168271+0000","last_fullsized":"2024-06-13T11:37:13.168271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713222+0000","last_change":"2024-06-13T11:37:07.810639+0000","last_active":"2024-06-13T11:37:13.713222+0000","last_peered":"2024-06-13T11:37:13.713222+0000","last_clean":"2024-06-13T11:37:13.713222+0000","last_became_active":"2024-06-13T11:37:07.810285+0000","last_became_peered":"2024-06-13T11:37:07.810285+0000","last_unstale":"2024-06-13T11:37:13.713222+0000","last_undegraded":"2024-06-13T11:37:13.713222+0000","last_fullsized":"2024-06-13T11:37:13.713222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821000+0000","last_change":"2024-06-13T11:37:07.804880+0000","last_active":"2024-06-13T11:37:12.821000+0000","last_peered":"2024-06-13T11:37:12.821000+0000","last_clean":"2024-06-13T11:37:12.821000+0000","last_became_active":"2024-06-13T11:37:07.803451+0000","last_became_peered":"2024-06-13T11:37:07.803451+0000","last_unstale":"2024-06-13T11:37:12.821000+0000","last_undegraded":"2024-06-13T11:37:12.821000+0000","last_fullsized":"2024-06-13T11:37:12.821000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153125+0000","last_change":"2024-06-13T11:37:07.808713+0000","last_active":"2024-06-13T11:37:13.153125+0000","last_peered":"2024-06-13T11:37:13.153125+0000","last_clean":"2024-06-13T11:37:13.153125+0000","last_became_active":"2024-06-13T11:37:07.808422+0000","last_became_peered":"2024-06-13T11:37:07.808422+0000","last_unstale":"2024-06-13T11:37:13.153125+0000","last_undegraded":"2024-06-13T11:37:13.153125+0000","last_fullsized":"2024-06-13T11:37:13.153125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712358+0000","last_change":"2024-06-13T11:37:07.808193+0000","last_active":"2024-06-13T11:37:13.712358+0000","last_peered":"2024-06-13T11:37:13.712358+0000","last_clean":"2024-06-13T11:37:13.712358+0000","last_became_active":"2024-06-13T11:37:07.807809+0000","last_became_peered":"2024-06-13T11:37:07.807809+0000","last_unstale":"2024-06-13T11:37:13.712358+0000","last_undegraded":"2024-06-13T11:37:13.712358+0000","last_fullsized":"2024-06-13T11:37:13.712358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:08.966864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168884+0000","last_change":"2024-06-13T11:37:07.826457+0000","last_active":"2024-06-13T11:37:13.168884+0000","last_peered":"2024-06-13T11:37:13.168884+0000","last_clean":"2024-06-13T11:37:13.168884+0000","last_became_active":"2024-06-13T11:37:07.826150+0000","last_became_peered":"2024-06-13T11:37:07.826150+0000","last_unstale":"2024-06-13T11:37:13.168884+0000","last_undegraded":"2024-06-13T11:37:13.168884+0000","last_fullsized":"2024-06-13T11:37:13.168884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168030+0000","last_change":"2024-06-13T11:37:07.817291+0000","last_active":"2024-06-13T11:37:13.168030+0000","last_peered":"2024-06-13T11:37:13.168030+0000","last_clean":"2024-06-13T11:37:13.168030+0000","last_became_active":"2024-06-13T11:37:07.817016+0000","last_became_peered":"2024-06-13T11:37:07.817016+0000","last_unstale":"2024-06-13T11:37:13.168030+0000","last_undegraded":"2024-06-13T11:37:13.168030+0000","last_fullsized":"2024-06-13T11:37:13.168030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:10.222966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819296+0000","last_change":"2024-06-13T11:37:07.807833+0000","last_active":"2024-06-13T11:37:12.819296+0000","last_peered":"2024-06-13T11:37:12.819296+0000","last_clean":"2024-06-13T11:37:12.819296+0000","last_became_active":"2024-06-13T11:37:07.807536+0000","last_became_peered":"2024-06-13T11:37:07.807536+0000","last_unstale":"2024-06-13T11:37:12.819296+0000","last_undegraded":"2024-06-13T11:37:12.819296+0000","last_fullsized":"2024-06-13T11:37:12.819296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713077+0000","last_change":"2024-06-13T11:37:07.809789+0000","last_active":"2024-06-13T11:37:13.713077+0000","last_peered":"2024-06-13T11:37:13.713077+0000","last_clean":"2024-06-13T11:37:13.713077+0000","last_became_active":"2024-06-13T11:37:07.809493+0000","last_became_peered":"2024-06-13T11:37:07.809493+0000","last_unstale":"2024-06-13T11:37:13.713077+0000","last_undegraded":"2024-06-13T11:37:13.713077+0000","last_fullsized":"2024-06-13T11:37:13.713077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:00.616643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713659+0000","last_change":"2024-06-13T11:37:07.808038+0000","last_active":"2024-06-13T11:37:13.713659+0000","last_peered":"2024-06-13T11:37:13.713659+0000","last_clean":"2024-06-13T11:37:13.713659+0000","last_became_active":"2024-06-13T11:37:07.807727+0000","last_became_peered":"2024-06-13T11:37:07.807727+0000","last_unstale":"2024-06-13T11:37:13.713659+0000","last_undegraded":"2024-06-13T11:37:13.713659+0000","last_fullsized":"2024-06-13T11:37:13.713659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821132+0000","last_change":"2024-06-13T11:37:07.807879+0000","last_active":"2024-06-13T11:37:12.821132+0000","last_peered":"2024-06-13T11:37:12.821132+0000","last_clean":"2024-06-13T11:37:12.821132+0000","last_became_active":"2024-06-13T11:37:07.807538+0000","last_became_peered":"2024-06-13T11:37:07.807538+0000","last_unstale":"2024-06-13T11:37:12.821132+0000","last_undegraded":"2024-06-13T11:37:12.821132+0000","last_fullsized":"2024-06-13T11:37:12.821132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:33.935198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821182+0000","last_change":"2024-06-13T11:37:07.809717+0000","last_active":"2024-06-13T11:37:12.821182+0000","last_peered":"2024-06-13T11:37:12.821182+0000","last_clean":"2024-06-13T11:37:12.821182+0000","last_became_active":"2024-06-13T11:37:07.809444+0000","last_became_peered":"2024-06-13T11:37:07.809444+0000","last_unstale":"2024-06-13T11:37:12.821182+0000","last_undegraded":"2024-06-13T11:37:12.821182+0000","last_fullsized":"2024-06-13T11:37:12.821182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821499+0000","last_change":"2024-06-13T11:37:07.810594+0000","last_active":"2024-06-13T11:37:12.821499+0000","last_peered":"2024-06-13T11:37:12.821499+0000","last_clean":"2024-06-13T11:37:12.821499+0000","last_became_active":"2024-06-13T11:37:07.810177+0000","last_became_peered":"2024-06-13T11:37:07.810177+0000","last_unstale":"2024-06-13T11:37:12.821499+0000","last_undegraded":"2024-06-13T11:37:12.821499+0000","last_fullsized":"2024-06-13T11:37:12.821499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153218+0000","last_change":"2024-06-13T11:37:07.824727+0000","last_active":"2024-06-13T11:37:13.153218+0000","last_peered":"2024-06-13T11:37:13.153218+0000","last_clean":"2024-06-13T11:37:13.153218+0000","last_became_active":"2024-06-13T11:37:07.824440+0000","last_became_peered":"2024-06-13T11:37:07.824440+0000","last_unstale":"2024-06-13T11:37:13.153218+0000","last_undegraded":"2024-06-13T11:37:13.153218+0000","last_fullsized":"2024-06-13T11:37:13.153218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712370+0000","last_change":"2024-06-13T11:37:07.811181+0000","last_active":"2024-06-13T11:37:13.712370+0000","last_peered":"2024-06-13T11:37:13.712370+0000","last_clean":"2024-06-13T11:37:13.712370+0000","last_became_active":"2024-06-13T11:37:07.810827+0000","last_became_peered":"2024-06-13T11:37:07.810827+0000","last_unstale":"2024-06-13T11:37:13.712370+0000","last_undegraded":"2024-06-13T11:37:13.712370+0000","last_fullsized":"2024-06-13T11:37:13.712370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152419+0000","last_change":"2024-06-13T11:37:07.817006+0000","last_active":"2024-06-13T11:37:13.152419+0000","last_peered":"2024-06-13T11:37:13.152419+0000","last_clean":"2024-06-13T11:37:13.152419+0000","last_became_active":"2024-06-13T11:37:07.816608+0000","last_became_peered":"2024-06-13T11:37:07.816608+0000","last_unstale":"2024-06-13T11:37:13.152419+0000","last_undegraded":"2024-06-13T11:37:13.152419+0000","last_fullsized":"2024-06-13T11:37:13.152419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168151+0000","last_change":"2024-06-13T11:37:07.816639+0000","last_active":"2024-06-13T11:37:13.168151+0000","last_peered":"2024-06-13T11:37:13.168151+0000","last_clean":"2024-06-13T11:37:13.168151+0000","last_became_active":"2024-06-13T11:37:07.816347+0000","last_became_peered":"2024-06-13T11:37:07.816347+0000","last_unstale":"2024-06-13T11:37:13.168151+0000","last_undegraded":"2024-06-13T11:37:13.168151+0000","last_fullsized":"2024-06-13T11:37:13.168151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:28:30.350625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152445+0000","last_change":"2024-06-13T11:37:07.818920+0000","last_active":"2024-06-13T11:37:13.152445+0000","last_peered":"2024-06-13T11:37:13.152445+0000","last_clean":"2024-06-13T11:37:13.152445+0000","last_became_active":"2024-06-13T11:37:07.818628+0000","last_became_peered":"2024-06-13T11:37:07.818628+0000","last_unstale":"2024-06-13T11:37:13.152445+0000","last_undegraded":"2024-06-13T11:37:13.152445+0000","last_fullsized":"2024-06-13T11:37:13.152445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168341+0000","last_change":"2024-06-13T11:37:07.812235+0000","last_active":"2024-06-13T11:37:13.168341+0000","last_peered":"2024-06-13T11:37:13.168341+0000","last_clean":"2024-06-13T11:37:13.168341+0000","last_became_active":"2024-06-13T11:37:07.811740+0000","last_became_peered":"2024-06-13T11:37:07.811740+0000","last_unstale":"2024-06-13T11:37:13.168341+0000","last_undegraded":"2024-06-13T11:37:13.168341+0000","last_fullsized":"2024-06-13T11:37:13.168341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:24:14.572925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712830+0000","last_change":"2024-06-13T11:37:07.810203+0000","last_active":"2024-06-13T11:37:13.712830+0000","last_peered":"2024-06-13T11:37:13.712830+0000","last_clean":"2024-06-13T11:37:13.712830+0000","last_became_active":"2024-06-13T11:37:07.809607+0000","last_became_peered":"2024-06-13T11:37:07.809607+0000","last_unstale":"2024-06-13T11:37:13.712830+0000","last_undegraded":"2024-06-13T11:37:13.712830+0000","last_fullsized":"2024-06-13T11:37:13.712830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820323+0000","last_change":"2024-06-13T11:37:07.815528+0000","last_active":"2024-06-13T11:37:12.820323+0000","last_peered":"2024-06-13T11:37:12.820323+0000","last_clean":"2024-06-13T11:37:12.820323+0000","last_became_active":"2024-06-13T11:37:07.815240+0000","last_became_peered":"2024-06-13T11:37:07.815240+0000","last_unstale":"2024-06-13T11:37:12.820323+0000","last_undegraded":"2024-06-13T11:37:12.820323+0000","last_fullsized":"2024-06-13T11:37:12.820323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153117+0000","last_change":"2024-06-13T11:37:07.822539+0000","last_active":"2024-06-13T11:37:13.153117+0000","last_peered":"2024-06-13T11:37:13.153117+0000","last_clean":"2024-06-13T11:37:13.153117+0000","last_became_active":"2024-06-13T11:37:07.820878+0000","last_became_peered":"2024-06-13T11:37:07.820878+0000","last_unstale":"2024-06-13T11:37:13.153117+0000","last_undegraded":"2024-06-13T11:37:13.153117+0000","last_fullsized":"2024-06-13T11:37:13.153117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:51.638079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":694641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":103781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":103817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":105303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":103691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":103851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":694697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:37:21.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:37:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.006+0000 7f40a0b90640 1 Processor -- start 2024-06-13T11:37:22.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.006+0000 7f40a0b90640 1 -- start start 2024-06-13T11:37:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.007+0000 7f40a0b90640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c141220 0x7f409c0aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.007+0000 7f40a0b90640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f409c15f620 0x7f409c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.007+0000 7f40a0b90640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f409c0aaed0 con 0x7f409c072140 2024-06-13T11:37:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.007+0000 7f40a0b90640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f409c0725b0 con 0x7f409c15f620 2024-06-13T11:37:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.007+0000 7f40a0b90640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f409c0ab1b0 con 0x7f409c141220 2024-06-13T11:37:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f409c072140 0x7f409c1439e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:41992/0 (socket says 172.21.15.43:41992) 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409ad9d640 1 -- 172.21.15.43:0/3205553261 learned_addr learned my addr 172.21.15.43:0/3205553261 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409a59c640 1 --2- 172.21.15.43:0/3205553261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c141220 0x7f409c0aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f4099d9b640 1 --2- 172.21.15.43:0/3205553261 >> v2:172.21.15.53:3300/0 conn(0x7f409c15f620 0x7f409c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409959a640 1 -- 172.21.15.43:0/3205553261 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242884137 0 0) 0x7f409c0aaed0 con 0x7f409c072140 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409959a640 1 -- 172.21.15.43:0/3205553261 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4088003520 con 0x7f409c072140 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409a59c640 1 -- 172.21.15.43:0/3205553261 >> v2:172.21.15.53:3300/0 conn(0x7f409c15f620 msgr2=0x7f409c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409a59c640 1 --2- 172.21.15.43:0/3205553261 >> v2:172.21.15.53:3300/0 conn(0x7f409c15f620 0x7f409c071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409a59c640 1 -- 172.21.15.43:0/3205553261 >> v1:172.21.15.53:6789/0 conn(0x7f409c072140 legacy=0x7f409c1439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f409a59c640 1 -- 172.21.15.43:0/3205553261 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c0ab490 con 0x7f409c141220 2024-06-13T11:37:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.008+0000 7f4099d9b640 1 --2- 172.21.15.43:0/3205553261 >> v2:172.21.15.53:3300/0 conn(0x7f409c15f620 0x7f409c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.009+0000 7f409a59c640 1 --2- 172.21.15.43:0/3205553261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c141220 0x7f409c0aa5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f408c009d90 tx=0x7f408c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6fc559ea4c78d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.009+0000 7f409959a640 1 -- 172.21.15.43:0/3205553261 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c007740 con 0x7f409c141220 2024-06-13T11:37:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.009+0000 7f409959a640 1 -- 172.21.15.43:0/3205553261 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c0078e0 con 0x7f409c141220 2024-06-13T11:37:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.009+0000 7f409959a640 1 -- 172.21.15.43:0/3205553261 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c007c90 con 0x7f409c141220 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.009+0000 7f40a0b90640 1 -- 172.21.15.43:0/3205553261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c141220 msgr2=0x7f409c0aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.009+0000 7f40a0b90640 1 --2- 172.21.15.43:0/3205553261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c141220 0x7f409c0aa5d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f408c009d90 tx=0x7f408c02a660 comp rx=0 tx=0).stop 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.010+0000 7f40a0b90640 1 -- 172.21.15.43:0/3205553261 shutdown_connections 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.010+0000 7f40a0b90640 1 --2- 172.21.15.43:0/3205553261 >> v2:172.21.15.53:3300/0 conn(0x7f409c15f620 0x7f409c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.010+0000 7f40a0b90640 1 --2- 172.21.15.43:0/3205553261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c141220 0x7f409c0aa5d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.010+0000 7f40a0b90640 1 -- 172.21.15.43:0/3205553261 >> 172.21.15.43:0/3205553261 conn(0x7f409c070810 msgr2=0x7f409c0d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.010+0000 7f40a0b90640 1 -- 172.21.15.43:0/3205553261 shutdown_connections 2024-06-13T11:37:22.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.010+0000 7f40a0b90640 1 -- 172.21.15.43:0/3205553261 wait complete. 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.011+0000 7f40a0b90640 1 Processor -- start 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.011+0000 7f40a0b90640 1 -- start start 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f40a0b90640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c072140 0x7f409c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f40a0b90640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 0x7f409c13dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f40a0b90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409c15f620 0x7f409c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f40a0b90640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0aab10 con 0x7f409c141220 2024-06-13T11:37:22.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f40a0b90640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f409c141600 con 0x7f409c15f620 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f40a0b90640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f409c0aac90 con 0x7f409c072140 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 0x7f409c13dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 0x7f409c13dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36432/0 (socket says 172.21.15.43:36432) 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 -- 172.21.15.43:0/1125239726 learned_addr learned my addr 172.21.15.43:0/1125239726 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f409a59c640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c072140 0x7f409c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f409ad9d640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409c15f620 0x7f409c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 -- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c072140 msgr2=0x7f409c15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c072140 0x7f409c15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 -- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409c15f620 msgr2=0x7f409c155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409c15f620 0x7f409c155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 -- 172.21.15.43:0/1125239726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c155e30 con 0x7f409c141220 2024-06-13T11:37:22.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4099d9b640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 0x7f409c13dda0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f408400e930 tx=0x7f408400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.012+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084017070 con 0x7f409c141220 2024-06-13T11:37:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.013+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408400ca00 con 0x7f409c141220 2024-06-13T11:37:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.013+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408400cdf0 con 0x7f409c141220 2024-06-13T11:37:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.013+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c156110 con 0x7f409c141220 2024-06-13T11:37:22.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.013+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c1566d0 con 0x7f409c141220 2024-06-13T11:37:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.014+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409c04ffb0 con 0x7f409c141220 2024-06-13T11:37:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.014+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f408401a070 con 0x7f409c141220 2024-06-13T11:37:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.015+0000 7f4092ffd640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f407c06be60 0x7f407c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.015+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f408408afe0 con 0x7f409c141220 2024-06-13T11:37:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.015+0000 7f409a59c640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f407c06be60 0x7f407c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.015+0000 7f409a59c640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f407c06be60 0x7f407c06e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f408c034000 tx=0x7f408c02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.019+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4084058ff0 con 0x7f409c141220 2024-06-13T11:37:22.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.202+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f409c156ed0 con 0x7f407c06be60 2024-06-13T11:37:22.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.210+0000 7f4092ffd640 1 -- 172.21.15.43:0/1125239726 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332633 (secure 0 0 0) 0x7f408c0076c0 con 0x7f407c06be60 2024-06-13T11:37:22.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:22.214 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.213+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f407c06be60 msgr2=0x7f407c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.213+0000 7f40a0b90640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f407c06be60 0x7f407c06e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f408c034000 tx=0x7f408c02f000 comp rx=0 tx=0).stop 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.213+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 msgr2=0x7f409c13dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.213+0000 7f40a0b90640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 0x7f409c13dda0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f408400e930 tx=0x7f408400edf0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 shutdown_connections 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f407c06be60 0x7f407c06e320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409c15f620 0x7f409c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f409c141220 0x7f409c13dda0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 --2- 172.21.15.43:0/1125239726 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f409c072140 0x7f409c15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 >> 172.21.15.43:0/1125239726 conn(0x7f409c070810 msgr2=0x7f409c15b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:22.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 shutdown_connections 2024-06-13T11:37:22.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.214+0000 7f40a0b90640 1 -- 172.21.15.43:0/1125239726 wait complete. 2024-06-13T11:37:22.224 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-06-13T11:37:21.352020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252728,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721992,"statfs":{"total":773094113280,"available":772835319808,"internally_reserved":0,"allocated":3350528,"data_stored":2017313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.536279"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713160+0000","last_change":"2024-06-13T11:37:06.802024+0000","last_active":"2024-06-13T11:37:13.713160+0000","last_peered":"2024-06-13T11:37:13.713160+0000","last_clean":"2024-06-13T11:37:13.713160+0000","last_became_active":"2024-06-13T11:37:06.801691+0000","last_became_peered":"2024-06-13T11:37:06.801691+0000","last_unstale":"2024-06-13T11:37:13.713160+0000","last_undegraded":"2024-06-13T11:37:13.713160+0000","last_fullsized":"2024-06-13T11:37:13.713160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713972+0000","last_change":"2024-06-13T11:37:07.811931+0000","last_active":"2024-06-13T11:37:13.713972+0000","last_peered":"2024-06-13T11:37:13.713972+0000","last_clean":"2024-06-13T11:37:13.713972+0000","last_became_active":"2024-06-13T11:37:07.811664+0000","last_became_peered":"2024-06-13T11:37:07.811664+0000","last_unstale":"2024-06-13T11:37:13.713972+0000","last_undegraded":"2024-06-13T11:37:13.713972+0000","last_fullsized":"2024-06-13T11:37:13.713972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713382+0000","last_change":"2024-06-13T11:37:12.056726+0000","last_active":"2024-06-13T11:37:13.713382+0000","last_peered":"2024-06-13T11:37:13.713382+0000","last_clean":"2024-06-13T11:37:13.713382+0000","last_became_active":"2024-06-13T11:37:12.056325+0000","last_became_peered":"2024-06-13T11:37:12.056325+0000","last_unstale":"2024-06-13T11:37:13.713382+0000","last_undegraded":"2024-06-13T11:37:13.713382+0000","last_fullsized":"2024-06-13T11:37:13.713382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.767571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714115+0000","last_change":"2024-06-13T11:37:06.796164+0000","last_active":"2024-06-13T11:37:13.714115+0000","last_peered":"2024-06-13T11:37:13.714115+0000","last_clean":"2024-06-13T11:37:13.714115+0000","last_became_active":"2024-06-13T11:37:06.795879+0000","last_became_peered":"2024-06-13T11:37:06.795879+0000","last_unstale":"2024-06-13T11:37:13.714115+0000","last_undegraded":"2024-06-13T11:37:13.714115+0000","last_fullsized":"2024-06-13T11:37:13.714115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712971+0000","last_change":"2024-06-13T11:37:07.816817+0000","last_active":"2024-06-13T11:37:13.712971+0000","last_peered":"2024-06-13T11:37:13.712971+0000","last_clean":"2024-06-13T11:37:13.712971+0000","last_became_active":"2024-06-13T11:37:07.816501+0000","last_became_peered":"2024-06-13T11:37:07.816501+0000","last_unstale":"2024-06-13T11:37:13.712971+0000","last_undegraded":"2024-06-13T11:37:13.712971+0000","last_fullsized":"2024-06-13T11:37:13.712971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819271+0000","last_change":"2024-06-13T11:37:11.840979+0000","last_active":"2024-06-13T11:37:12.819271+0000","last_peered":"2024-06-13T11:37:12.819271+0000","last_clean":"2024-06-13T11:37:12.819271+0000","last_became_active":"2024-06-13T11:37:11.840530+0000","last_became_peered":"2024-06-13T11:37:11.840530+0000","last_unstale":"2024-06-13T11:37:12.819271+0000","last_undegraded":"2024-06-13T11:37:12.819271+0000","last_fullsized":"2024-06-13T11:37:12.819271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:49.007922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152993+0000","last_change":"2024-06-13T11:37:06.804220+0000","last_active":"2024-06-13T11:37:13.152993+0000","last_peered":"2024-06-13T11:37:13.152993+0000","last_clean":"2024-06-13T11:37:13.152993+0000","last_became_active":"2024-06-13T11:37:06.803905+0000","last_became_peered":"2024-06-13T11:37:06.803905+0000","last_unstale":"2024-06-13T11:37:13.152993+0000","last_undegraded":"2024-06-13T11:37:13.152993+0000","last_fullsized":"2024-06-13T11:37:13.152993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168438+0000","last_change":"2024-06-13T11:37:07.818064+0000","last_active":"2024-06-13T11:37:13.168438+0000","last_peered":"2024-06-13T11:37:13.168438+0000","last_clean":"2024-06-13T11:37:13.168438+0000","last_became_active":"2024-06-13T11:37:07.817790+0000","last_became_peered":"2024-06-13T11:37:07.817790+0000","last_unstale":"2024-06-13T11:37:13.168438+0000","last_undegraded":"2024-06-13T11:37:13.168438+0000","last_fullsized":"2024-06-13T11:37:13.168438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819367+0000","last_change":"2024-06-13T11:37:11.843208+0000","last_active":"2024-06-13T11:37:12.819367+0000","last_peered":"2024-06-13T11:37:12.819367+0000","last_clean":"2024-06-13T11:37:12.819367+0000","last_became_active":"2024-06-13T11:37:11.842808+0000","last_became_peered":"2024-06-13T11:37:11.842808+0000","last_unstale":"2024-06-13T11:37:12.819367+0000","last_undegraded":"2024-06-13T11:37:12.819367+0000","last_fullsized":"2024-06-13T11:37:12.819367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:39.425819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152791+0000","last_change":"2024-06-13T11:37:06.806036+0000","last_active":"2024-06-13T11:37:13.152791+0000","last_peered":"2024-06-13T11:37:13.152791+0000","last_clean":"2024-06-13T11:37:13.152791+0000","last_became_active":"2024-06-13T11:37:06.805633+0000","last_became_peered":"2024-06-13T11:37:06.805633+0000","last_unstale":"2024-06-13T11:37:13.152791+0000","last_undegraded":"2024-06-13T11:37:13.152791+0000","last_fullsized":"2024-06-13T11:37:13.152791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168608+0000","last_change":"2024-06-13T11:37:07.818181+0000","last_active":"2024-06-13T11:37:13.168608+0000","last_peered":"2024-06-13T11:37:13.168608+0000","last_clean":"2024-06-13T11:37:13.168608+0000","last_became_active":"2024-06-13T11:37:07.817838+0000","last_became_peered":"2024-06-13T11:37:07.817838+0000","last_unstale":"2024-06-13T11:37:13.168608+0000","last_undegraded":"2024-06-13T11:37:13.168608+0000","last_fullsized":"2024-06-13T11:37:13.168608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819379+0000","last_change":"2024-06-13T11:37:11.836030+0000","last_active":"2024-06-13T11:37:12.819379+0000","last_peered":"2024-06-13T11:37:12.819379+0000","last_clean":"2024-06-13T11:37:12.819379+0000","last_became_active":"2024-06-13T11:37:11.835623+0000","last_became_peered":"2024-06-13T11:37:11.835623+0000","last_unstale":"2024-06-13T11:37:12.819379+0000","last_undegraded":"2024-06-13T11:37:12.819379+0000","last_fullsized":"2024-06-13T11:37:12.819379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:15.824916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821023+0000","last_change":"2024-06-13T11:37:07.801421+0000","last_active":"2024-06-13T11:37:12.821023+0000","last_peered":"2024-06-13T11:37:12.821023+0000","last_clean":"2024-06-13T11:37:12.821023+0000","last_became_active":"2024-06-13T11:37:07.801091+0000","last_became_peered":"2024-06-13T11:37:07.801091+0000","last_unstale":"2024-06-13T11:37:12.821023+0000","last_undegraded":"2024-06-13T11:37:12.821023+0000","last_fullsized":"2024-06-13T11:37:12.821023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152797+0000","last_change":"2024-06-13T11:37:06.800654+0000","last_active":"2024-06-13T11:37:13.152797+0000","last_peered":"2024-06-13T11:37:13.152797+0000","last_clean":"2024-06-13T11:37:13.152797+0000","last_became_active":"2024-06-13T11:37:06.800354+0000","last_became_peered":"2024-06-13T11:37:06.800354+0000","last_unstale":"2024-06-13T11:37:13.152797+0000","last_undegraded":"2024-06-13T11:37:13.152797+0000","last_fullsized":"2024-06-13T11:37:13.152797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:30.194270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821793+0000","last_change":"2024-06-13T11:37:11.844730+0000","last_active":"2024-06-13T11:37:12.821793+0000","last_peered":"2024-06-13T11:37:12.821793+0000","last_clean":"2024-06-13T11:37:12.821793+0000","last_became_active":"2024-06-13T11:37:11.844339+0000","last_became_peered":"2024-06-13T11:37:11.844339+0000","last_unstale":"2024-06-13T11:37:12.821793+0000","last_undegraded":"2024-06-13T11:37:12.821793+0000","last_fullsized":"2024-06-13T11:37:12.821793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:55.671685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713768+0000","last_change":"2024-06-13T11:37:07.814526+0000","last_active":"2024-06-13T11:37:13.713768+0000","last_peered":"2024-06-13T11:37:13.713768+0000","last_clean":"2024-06-13T11:37:13.713768+0000","last_became_active":"2024-06-13T11:37:07.814074+0000","last_became_peered":"2024-06-13T11:37:07.814074+0000","last_unstale":"2024-06-13T11:37:13.713768+0000","last_undegraded":"2024-06-13T11:37:13.713768+0000","last_fullsized":"2024-06-13T11:37:13.713768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820029+0000","last_change":"2024-06-13T11:37:06.796287+0000","last_active":"2024-06-13T11:37:12.820029+0000","last_peered":"2024-06-13T11:37:12.820029+0000","last_clean":"2024-06-13T11:37:12.820029+0000","last_became_active":"2024-06-13T11:37:06.796000+0000","last_became_peered":"2024-06-13T11:37:06.796000+0000","last_unstale":"2024-06-13T11:37:12.820029+0000","last_undegraded":"2024-06-13T11:37:12.820029+0000","last_fullsized":"2024-06-13T11:37:12.820029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820470+0000","last_change":"2024-06-13T11:37:11.842232+0000","last_active":"2024-06-13T11:37:12.820470+0000","last_peered":"2024-06-13T11:37:12.820470+0000","last_clean":"2024-06-13T11:37:12.820470+0000","last_became_active":"2024-06-13T11:37:11.841627+0000","last_became_peered":"2024-06-13T11:37:11.841627+0000","last_unstale":"2024-06-13T11:37:12.820470+0000","last_undegraded":"2024-06-13T11:37:12.820470+0000","last_fullsized":"2024-06-13T11:37:12.820470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:18.353072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712704+0000","last_change":"2024-06-13T11:37:07.811429+0000","last_active":"2024-06-13T11:37:13.712704+0000","last_peered":"2024-06-13T11:37:13.712704+0000","last_clean":"2024-06-13T11:37:13.712704+0000","last_became_active":"2024-06-13T11:37:07.811115+0000","last_became_peered":"2024-06-13T11:37:07.811115+0000","last_unstale":"2024-06-13T11:37:13.712704+0000","last_undegraded":"2024-06-13T11:37:13.712704+0000","last_fullsized":"2024-06-13T11:37:13.712704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819414+0000","last_change":"2024-06-13T11:37:06.800946+0000","last_active":"2024-06-13T11:37:12.819414+0000","last_peered":"2024-06-13T11:37:12.819414+0000","last_clean":"2024-06-13T11:37:12.819414+0000","last_became_active":"2024-06-13T11:37:06.800694+0000","last_became_peered":"2024-06-13T11:37:06.800694+0000","last_unstale":"2024-06-13T11:37:12.819414+0000","last_undegraded":"2024-06-13T11:37:12.819414+0000","last_fullsized":"2024-06-13T11:37:12.819414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820472+0000","last_change":"2024-06-13T11:37:12.056325+0000","last_active":"2024-06-13T11:37:12.820472+0000","last_peered":"2024-06-13T11:37:12.820472+0000","last_clean":"2024-06-13T11:37:12.820472+0000","last_became_active":"2024-06-13T11:37:12.055942+0000","last_became_peered":"2024-06-13T11:37:12.055942+0000","last_unstale":"2024-06-13T11:37:12.820472+0000","last_undegraded":"2024-06-13T11:37:12.820472+0000","last_fullsized":"2024-06-13T11:37:12.820472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819614+0000","last_change":"2024-06-13T11:37:07.802398+0000","last_active":"2024-06-13T11:37:12.819614+0000","last_peered":"2024-06-13T11:37:12.819614+0000","last_clean":"2024-06-13T11:37:12.819614+0000","last_became_active":"2024-06-13T11:37:07.799881+0000","last_became_peered":"2024-06-13T11:37:07.799881+0000","last_unstale":"2024-06-13T11:37:12.819614+0000","last_undegraded":"2024-06-13T11:37:12.819614+0000","last_fullsized":"2024-06-13T11:37:12.819614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:48.876977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152403+0000","last_change":"2024-06-13T11:37:06.801936+0000","last_active":"2024-06-13T11:37:13.152403+0000","last_peered":"2024-06-13T11:37:13.152403+0000","last_clean":"2024-06-13T11:37:13.152403+0000","last_became_active":"2024-06-13T11:37:06.801627+0000","last_became_peered":"2024-06-13T11:37:06.801627+0000","last_unstale":"2024-06-13T11:37:13.152403+0000","last_undegraded":"2024-06-13T11:37:13.152403+0000","last_fullsized":"2024-06-13T11:37:13.152403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:47.872930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821463+0000","last_change":"2024-06-13T11:37:11.842008+0000","last_active":"2024-06-13T11:37:12.821463+0000","last_peered":"2024-06-13T11:37:12.821463+0000","last_clean":"2024-06-13T11:37:12.821463+0000","last_became_active":"2024-06-13T11:37:11.840561+0000","last_became_peered":"2024-06-13T11:37:11.840561+0000","last_unstale":"2024-06-13T11:37:12.821463+0000","last_undegraded":"2024-06-13T11:37:12.821463+0000","last_fullsized":"2024-06-13T11:37:12.821463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:08.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713459+0000","last_change":"2024-06-13T11:37:07.805913+0000","last_active":"2024-06-13T11:37:13.713459+0000","last_peered":"2024-06-13T11:37:13.713459+0000","last_clean":"2024-06-13T11:37:13.713459+0000","last_became_active":"2024-06-13T11:37:07.805604+0000","last_became_peered":"2024-06-13T11:37:07.805604+0000","last_unstale":"2024-06-13T11:37:13.713459+0000","last_undegraded":"2024-06-13T11:37:13.713459+0000","last_fullsized":"2024-06-13T11:37:13.713459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821692+0000","last_change":"2024-06-13T11:37:06.798167+0000","last_active":"2024-06-13T11:37:12.821692+0000","last_peered":"2024-06-13T11:37:12.821692+0000","last_clean":"2024-06-13T11:37:12.821692+0000","last_became_active":"2024-06-13T11:37:06.797830+0000","last_became_peered":"2024-06-13T11:37:06.797830+0000","last_unstale":"2024-06-13T11:37:12.821692+0000","last_undegraded":"2024-06-13T11:37:12.821692+0000","last_fullsized":"2024-06-13T11:37:12.821692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819540+0000","last_change":"2024-06-13T11:37:12.061010+0000","last_active":"2024-06-13T11:37:12.819540+0000","last_peered":"2024-06-13T11:37:12.819540+0000","last_clean":"2024-06-13T11:37:12.819540+0000","last_became_active":"2024-06-13T11:37:12.059153+0000","last_became_peered":"2024-06-13T11:37:12.059153+0000","last_unstale":"2024-06-13T11:37:12.819540+0000","last_undegraded":"2024-06-13T11:37:12.819540+0000","last_fullsized":"2024-06-13T11:37:12.819540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:51.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714310+0000","last_change":"2024-06-13T11:37:07.813451+0000","last_active":"2024-06-13T11:37:13.714310+0000","last_peered":"2024-06-13T11:37:13.714310+0000","last_clean":"2024-06-13T11:37:13.714310+0000","last_became_active":"2024-06-13T11:37:07.813139+0000","last_became_peered":"2024-06-13T11:37:07.813139+0000","last_unstale":"2024-06-13T11:37:13.714310+0000","last_undegraded":"2024-06-13T11:37:13.714310+0000","last_fullsized":"2024-06-13T11:37:13.714310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820425+0000","last_change":"2024-06-13T11:37:06.791276+0000","last_active":"2024-06-13T11:37:12.820425+0000","last_peered":"2024-06-13T11:37:12.820425+0000","last_clean":"2024-06-13T11:37:12.820425+0000","last_became_active":"2024-06-13T11:37:06.790984+0000","last_became_peered":"2024-06-13T11:37:06.790984+0000","last_unstale":"2024-06-13T11:37:12.820425+0000","last_undegraded":"2024-06-13T11:37:12.820425+0000","last_fullsized":"2024-06-13T11:37:12.820425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712213+0000","last_change":"2024-06-13T11:37:12.056185+0000","last_active":"2024-06-13T11:37:13.712213+0000","last_peered":"2024-06-13T11:37:13.712213+0000","last_clean":"2024-06-13T11:37:13.712213+0000","last_became_active":"2024-06-13T11:37:12.055801+0000","last_became_peered":"2024-06-13T11:37:12.055801+0000","last_unstale":"2024-06-13T11:37:13.712213+0000","last_undegraded":"2024-06-13T11:37:13.712213+0000","last_fullsized":"2024-06-13T11:37:13.712213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:48:35.821250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820132+0000","last_change":"2024-06-13T11:37:07.806070+0000","last_active":"2024-06-13T11:37:12.820132+0000","last_peered":"2024-06-13T11:37:12.820132+0000","last_clean":"2024-06-13T11:37:12.820132+0000","last_became_active":"2024-06-13T11:37:07.805709+0000","last_became_peered":"2024-06-13T11:37:07.805709+0000","last_unstale":"2024-06-13T11:37:12.820132+0000","last_undegraded":"2024-06-13T11:37:12.820132+0000","last_fullsized":"2024-06-13T11:37:12.820132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153136+0000","last_change":"2024-06-13T11:37:06.802281+0000","last_active":"2024-06-13T11:37:13.153136+0000","last_peered":"2024-06-13T11:37:13.153136+0000","last_clean":"2024-06-13T11:37:13.153136+0000","last_became_active":"2024-06-13T11:37:06.801980+0000","last_became_peered":"2024-06-13T11:37:06.801980+0000","last_unstale":"2024-06-13T11:37:13.153136+0000","last_undegraded":"2024-06-13T11:37:13.153136+0000","last_fullsized":"2024-06-13T11:37:13.153136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:12.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713126+0000","last_change":"2024-06-13T11:37:12.058285+0000","last_active":"2024-06-13T11:37:13.713126+0000","last_peered":"2024-06-13T11:37:13.713126+0000","last_clean":"2024-06-13T11:37:13.713126+0000","last_became_active":"2024-06-13T11:37:12.056488+0000","last_became_peered":"2024-06-13T11:37:12.056488+0000","last_unstale":"2024-06-13T11:37:13.713126+0000","last_undegraded":"2024-06-13T11:37:13.713126+0000","last_fullsized":"2024-06-13T11:37:13.713126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168770+0000","last_change":"2024-06-13T11:37:07.819314+0000","last_active":"2024-06-13T11:37:13.168770+0000","last_peered":"2024-06-13T11:37:13.168770+0000","last_clean":"2024-06-13T11:37:13.168770+0000","last_became_active":"2024-06-13T11:37:07.819030+0000","last_became_peered":"2024-06-13T11:37:07.819030+0000","last_unstale":"2024-06-13T11:37:13.168770+0000","last_undegraded":"2024-06-13T11:37:13.168770+0000","last_fullsized":"2024-06-13T11:37:13.168770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820299+0000","last_change":"2024-06-13T11:37:06.793665+0000","last_active":"2024-06-13T11:37:12.820299+0000","last_peered":"2024-06-13T11:37:12.820299+0000","last_clean":"2024-06-13T11:37:12.820299+0000","last_became_active":"2024-06-13T11:37:06.793369+0000","last_became_peered":"2024-06-13T11:37:06.793369+0000","last_unstale":"2024-06-13T11:37:12.820299+0000","last_undegraded":"2024-06-13T11:37:12.820299+0000","last_fullsized":"2024-06-13T11:37:12.820299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819444+0000","last_change":"2024-06-13T11:37:11.840712+0000","last_active":"2024-06-13T11:37:12.819444+0000","last_peered":"2024-06-13T11:37:12.819444+0000","last_clean":"2024-06-13T11:37:12.819444+0000","last_became_active":"2024-06-13T11:37:11.840256+0000","last_became_peered":"2024-06-13T11:37:11.840256+0000","last_unstale":"2024-06-13T11:37:12.819444+0000","last_undegraded":"2024-06-13T11:37:12.819444+0000","last_fullsized":"2024-06-13T11:37:12.819444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820268+0000","last_change":"2024-06-13T11:37:07.814284+0000","last_active":"2024-06-13T11:37:12.820268+0000","last_peered":"2024-06-13T11:37:12.820268+0000","last_clean":"2024-06-13T11:37:12.820268+0000","last_became_active":"2024-06-13T11:37:07.813867+0000","last_became_peered":"2024-06-13T11:37:07.813867+0000","last_unstale":"2024-06-13T11:37:12.820268+0000","last_undegraded":"2024-06-13T11:37:12.820268+0000","last_fullsized":"2024-06-13T11:37:12.820268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:31.198317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168467+0000","last_change":"2024-06-13T11:37:06.805668+0000","last_active":"2024-06-13T11:37:13.168467+0000","last_peered":"2024-06-13T11:37:13.168467+0000","last_clean":"2024-06-13T11:37:13.168467+0000","last_became_active":"2024-06-13T11:37:06.803111+0000","last_became_peered":"2024-06-13T11:37:06.803111+0000","last_unstale":"2024-06-13T11:37:13.168467+0000","last_undegraded":"2024-06-13T11:37:13.168467+0000","last_fullsized":"2024-06-13T11:37:13.168467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820285+0000","last_change":"2024-06-13T11:37:11.841192+0000","last_active":"2024-06-13T11:37:12.820285+0000","last_peered":"2024-06-13T11:37:12.820285+0000","last_clean":"2024-06-13T11:37:12.820285+0000","last_became_active":"2024-06-13T11:37:11.840770+0000","last_became_peered":"2024-06-13T11:37:11.840770+0000","last_unstale":"2024-06-13T11:37:12.820285+0000","last_undegraded":"2024-06-13T11:37:12.820285+0000","last_fullsized":"2024-06-13T11:37:12.820285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819312+0000","last_change":"2024-06-13T11:37:07.806798+0000","last_active":"2024-06-13T11:37:12.819312+0000","last_peered":"2024-06-13T11:37:12.819312+0000","last_clean":"2024-06-13T11:37:12.819312+0000","last_became_active":"2024-06-13T11:37:07.806493+0000","last_became_peered":"2024-06-13T11:37:07.806493+0000","last_unstale":"2024-06-13T11:37:12.819312+0000","last_undegraded":"2024-06-13T11:37:12.819312+0000","last_fullsized":"2024-06-13T11:37:12.819312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712371+0000","last_change":"2024-06-13T11:37:06.797307+0000","last_active":"2024-06-13T11:37:13.712371+0000","last_peered":"2024-06-13T11:37:13.712371+0000","last_clean":"2024-06-13T11:37:13.712371+0000","last_became_active":"2024-06-13T11:37:06.796897+0000","last_became_peered":"2024-06-13T11:37:06.796897+0000","last_unstale":"2024-06-13T11:37:13.712371+0000","last_undegraded":"2024-06-13T11:37:13.712371+0000","last_fullsized":"2024-06-13T11:37:13.712371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820560+0000","last_change":"2024-06-13T11:37:11.842116+0000","last_active":"2024-06-13T11:37:12.820560+0000","last_peered":"2024-06-13T11:37:12.820560+0000","last_clean":"2024-06-13T11:37:12.820560+0000","last_became_active":"2024-06-13T11:37:11.841597+0000","last_became_peered":"2024-06-13T11:37:11.841597+0000","last_unstale":"2024-06-13T11:37:12.820560+0000","last_undegraded":"2024-06-13T11:37:12.820560+0000","last_fullsized":"2024-06-13T11:37:12.820560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712832+0000","last_change":"2024-06-13T11:37:07.808451+0000","last_active":"2024-06-13T11:37:13.712832+0000","last_peered":"2024-06-13T11:37:13.712832+0000","last_clean":"2024-06-13T11:37:13.712832+0000","last_became_active":"2024-06-13T11:37:07.808158+0000","last_became_peered":"2024-06-13T11:37:07.808158+0000","last_unstale":"2024-06-13T11:37:13.712832+0000","last_undegraded":"2024-06-13T11:37:13.712832+0000","last_fullsized":"2024-06-13T11:37:13.712832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:06:11.057302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152421+0000","last_change":"2024-06-13T11:37:06.804573+0000","last_active":"2024-06-13T11:37:13.152421+0000","last_peered":"2024-06-13T11:37:13.152421+0000","last_clean":"2024-06-13T11:37:13.152421+0000","last_became_active":"2024-06-13T11:37:06.804222+0000","last_became_peered":"2024-06-13T11:37:06.804222+0000","last_unstale":"2024-06-13T11:37:13.152421+0000","last_undegraded":"2024-06-13T11:37:13.152421+0000","last_fullsized":"2024-06-13T11:37:13.152421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:32.931150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713243+0000","last_change":"2024-06-13T11:37:12.057907+0000","last_active":"2024-06-13T11:37:13.713243+0000","last_peered":"2024-06-13T11:37:13.713243+0000","last_clean":"2024-06-13T11:37:13.713243+0000","last_became_active":"2024-06-13T11:37:12.056975+0000","last_became_peered":"2024-06-13T11:37:12.056975+0000","last_unstale":"2024-06-13T11:37:13.713243+0000","last_undegraded":"2024-06-13T11:37:13.713243+0000","last_fullsized":"2024-06-13T11:37:13.713243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713310+0000","last_change":"2024-06-13T11:37:07.812853+0000","last_active":"2024-06-13T11:37:13.713310+0000","last_peered":"2024-06-13T11:37:13.713310+0000","last_clean":"2024-06-13T11:37:13.713310+0000","last_became_active":"2024-06-13T11:37:07.812292+0000","last_became_peered":"2024-06-13T11:37:07.812292+0000","last_unstale":"2024-06-13T11:37:13.713310+0000","last_undegraded":"2024-06-13T11:37:13.713310+0000","last_fullsized":"2024-06-13T11:37:13.713310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:22.022588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168381+0000","last_change":"2024-06-13T11:37:06.801964+0000","last_active":"2024-06-13T11:37:13.168381+0000","last_peered":"2024-06-13T11:37:13.168381+0000","last_clean":"2024-06-13T11:37:13.168381+0000","last_became_active":"2024-06-13T11:37:06.801593+0000","last_became_peered":"2024-06-13T11:37:06.801593+0000","last_unstale":"2024-06-13T11:37:13.168381+0000","last_undegraded":"2024-06-13T11:37:13.168381+0000","last_fullsized":"2024-06-13T11:37:13.168381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152564+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:13.152564+0000","last_peered":"2024-06-13T11:37:13.152564+0000","last_clean":"2024-06-13T11:37:13.152564+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:13.152564+0000","last_undegraded":"2024-06-13T11:37:13.152564+0000","last_fullsized":"2024-06-13T11:37:13.152564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821546+0000","last_change":"2024-06-13T11:37:12.059771+0000","last_active":"2024-06-13T11:37:12.821546+0000","last_peered":"2024-06-13T11:37:12.821546+0000","last_clean":"2024-06-13T11:37:12.821546+0000","last_became_active":"2024-06-13T11:37:12.059321+0000","last_became_peered":"2024-06-13T11:37:12.059321+0000","last_unstale":"2024-06-13T11:37:12.821546+0000","last_undegraded":"2024-06-13T11:37:12.821546+0000","last_fullsized":"2024-06-13T11:37:12.821546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152859+0000","last_change":"2024-06-13T11:37:07.811589+0000","last_active":"2024-06-13T11:37:13.152859+0000","last_peered":"2024-06-13T11:37:13.152859+0000","last_clean":"2024-06-13T11:37:13.152859+0000","last_became_active":"2024-06-13T11:37:07.809978+0000","last_became_peered":"2024-06-13T11:37:07.809978+0000","last_unstale":"2024-06-13T11:37:13.152859+0000","last_undegraded":"2024-06-13T11:37:13.152859+0000","last_fullsized":"2024-06-13T11:37:13.152859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713015+0000","last_change":"2024-06-13T11:37:06.803922+0000","last_active":"2024-06-13T11:37:13.713015+0000","last_peered":"2024-06-13T11:37:13.713015+0000","last_clean":"2024-06-13T11:37:13.713015+0000","last_became_active":"2024-06-13T11:37:06.803580+0000","last_became_peered":"2024-06-13T11:37:06.803580+0000","last_unstale":"2024-06-13T11:37:13.713015+0000","last_undegraded":"2024-06-13T11:37:13.713015+0000","last_fullsized":"2024-06-13T11:37:13.713015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820954+0000","last_change":"2024-06-13T11:37:12.057052+0000","last_active":"2024-06-13T11:37:12.820954+0000","last_peered":"2024-06-13T11:37:12.820954+0000","last_clean":"2024-06-13T11:37:12.820954+0000","last_became_active":"2024-06-13T11:37:12.056584+0000","last_became_peered":"2024-06-13T11:37:12.056584+0000","last_unstale":"2024-06-13T11:37:12.820954+0000","last_undegraded":"2024-06-13T11:37:12.820954+0000","last_fullsized":"2024-06-13T11:37:12.820954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168499+0000","last_change":"2024-06-13T11:37:07.812006+0000","last_active":"2024-06-13T11:37:13.168499+0000","last_peered":"2024-06-13T11:37:13.168499+0000","last_clean":"2024-06-13T11:37:13.168499+0000","last_became_active":"2024-06-13T11:37:07.811291+0000","last_became_peered":"2024-06-13T11:37:07.811291+0000","last_unstale":"2024-06-13T11:37:13.168499+0000","last_undegraded":"2024-06-13T11:37:13.168499+0000","last_fullsized":"2024-06-13T11:37:13.168499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820081+0000","last_change":"2024-06-13T11:37:06.795354+0000","last_active":"2024-06-13T11:37:12.820081+0000","last_peered":"2024-06-13T11:37:12.820081+0000","last_clean":"2024-06-13T11:37:12.820081+0000","last_became_active":"2024-06-13T11:37:06.795061+0000","last_became_peered":"2024-06-13T11:37:06.795061+0000","last_unstale":"2024-06-13T11:37:12.820081+0000","last_undegraded":"2024-06-13T11:37:12.820081+0000","last_fullsized":"2024-06-13T11:37:12.820081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:03.016226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713370+0000","last_change":"2024-06-13T11:37:11.837119+0000","last_active":"2024-06-13T11:37:13.713370+0000","last_peered":"2024-06-13T11:37:13.713370+0000","last_clean":"2024-06-13T11:37:13.713370+0000","last_became_active":"2024-06-13T11:37:11.835585+0000","last_became_peered":"2024-06-13T11:37:11.835585+0000","last_unstale":"2024-06-13T11:37:13.713370+0000","last_undegraded":"2024-06-13T11:37:13.713370+0000","last_fullsized":"2024-06-13T11:37:13.713370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153245+0000","last_change":"2024-06-13T11:37:07.824375+0000","last_active":"2024-06-13T11:37:13.153245+0000","last_peered":"2024-06-13T11:37:13.153245+0000","last_clean":"2024-06-13T11:37:13.153245+0000","last_became_active":"2024-06-13T11:37:07.823632+0000","last_became_peered":"2024-06-13T11:37:07.823632+0000","last_unstale":"2024-06-13T11:37:13.153245+0000","last_undegraded":"2024-06-13T11:37:13.153245+0000","last_fullsized":"2024-06-13T11:37:13.153245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:31:03.309590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712454+0000","last_change":"2024-06-13T11:37:06.795631+0000","last_active":"2024-06-13T11:37:13.712454+0000","last_peered":"2024-06-13T11:37:13.712454+0000","last_clean":"2024-06-13T11:37:13.712454+0000","last_became_active":"2024-06-13T11:37:06.795324+0000","last_became_peered":"2024-06-13T11:37:06.795324+0000","last_unstale":"2024-06-13T11:37:13.712454+0000","last_undegraded":"2024-06-13T11:37:13.712454+0000","last_fullsized":"2024-06-13T11:37:13.712454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168005+0000","last_change":"2024-06-13T11:37:12.057488+0000","last_active":"2024-06-13T11:37:13.168005+0000","last_peered":"2024-06-13T11:37:13.168005+0000","last_clean":"2024-06-13T11:37:13.168005+0000","last_became_active":"2024-06-13T11:37:12.055585+0000","last_became_peered":"2024-06-13T11:37:12.055585+0000","last_unstale":"2024-06-13T11:37:13.168005+0000","last_undegraded":"2024-06-13T11:37:13.168005+0000","last_fullsized":"2024-06-13T11:37:13.168005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:50:00.925587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153108+0000","last_change":"2024-06-13T11:37:07.820932+0000","last_active":"2024-06-13T11:37:13.153108+0000","last_peered":"2024-06-13T11:37:13.153108+0000","last_clean":"2024-06-13T11:37:13.153108+0000","last_became_active":"2024-06-13T11:37:07.820617+0000","last_became_peered":"2024-06-13T11:37:07.820617+0000","last_unstale":"2024-06-13T11:37:13.153108+0000","last_undegraded":"2024-06-13T11:37:13.153108+0000","last_fullsized":"2024-06-13T11:37:13.153108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821493+0000","last_change":"2024-06-13T11:37:06.794223+0000","last_active":"2024-06-13T11:37:12.821493+0000","last_peered":"2024-06-13T11:37:12.821493+0000","last_clean":"2024-06-13T11:37:12.821493+0000","last_became_active":"2024-06-13T11:37:06.793864+0000","last_became_peered":"2024-06-13T11:37:06.793864+0000","last_unstale":"2024-06-13T11:37:12.821493+0000","last_undegraded":"2024-06-13T11:37:12.821493+0000","last_fullsized":"2024-06-13T11:37:12.821493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819177+0000","last_change":"2024-06-13T11:37:11.840914+0000","last_active":"2024-06-13T11:37:12.819177+0000","last_peered":"2024-06-13T11:37:12.819177+0000","last_clean":"2024-06-13T11:37:12.819177+0000","last_became_active":"2024-06-13T11:37:11.840526+0000","last_became_peered":"2024-06-13T11:37:11.840526+0000","last_unstale":"2024-06-13T11:37:12.819177+0000","last_undegraded":"2024-06-13T11:37:12.819177+0000","last_fullsized":"2024-06-13T11:37:12.819177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:43.551508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152587+0000","last_change":"2024-06-13T11:37:07.822417+0000","last_active":"2024-06-13T11:37:13.152587+0000","last_peered":"2024-06-13T11:37:13.152587+0000","last_clean":"2024-06-13T11:37:13.152587+0000","last_became_active":"2024-06-13T11:37:07.822089+0000","last_became_peered":"2024-06-13T11:37:07.822089+0000","last_unstale":"2024-06-13T11:37:13.152587+0000","last_undegraded":"2024-06-13T11:37:13.152587+0000","last_fullsized":"2024-06-13T11:37:13.152587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712075+0000","last_change":"2024-06-13T11:37:06.785156+0000","last_active":"2024-06-13T11:37:13.712075+0000","last_peered":"2024-06-13T11:37:13.712075+0000","last_clean":"2024-06-13T11:37:13.712075+0000","last_became_active":"2024-06-13T11:37:06.784829+0000","last_became_peered":"2024-06-13T11:37:06.784829+0000","last_unstale":"2024-06-13T11:37:13.712075+0000","last_undegraded":"2024-06-13T11:37:13.712075+0000","last_fullsized":"2024-06-13T11:37:13.712075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712893+0000","last_change":"2024-06-13T11:37:11.838670+0000","last_active":"2024-06-13T11:37:13.712893+0000","last_peered":"2024-06-13T11:37:13.712893+0000","last_clean":"2024-06-13T11:37:13.712893+0000","last_became_active":"2024-06-13T11:37:11.838262+0000","last_became_peered":"2024-06-13T11:37:11.838262+0000","last_unstale":"2024-06-13T11:37:13.712893+0000","last_undegraded":"2024-06-13T11:37:13.712893+0000","last_fullsized":"2024-06-13T11:37:13.712893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:17.899945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820178+0000","last_change":"2024-06-13T11:37:07.816286+0000","last_active":"2024-06-13T11:37:12.820178+0000","last_peered":"2024-06-13T11:37:12.820178+0000","last_clean":"2024-06-13T11:37:12.820178+0000","last_became_active":"2024-06-13T11:37:07.815777+0000","last_became_peered":"2024-06-13T11:37:07.815777+0000","last_unstale":"2024-06-13T11:37:12.820178+0000","last_undegraded":"2024-06-13T11:37:12.820178+0000","last_fullsized":"2024-06-13T11:37:12.820178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820785+0000","last_change":"2024-06-13T11:37:06.789763+0000","last_active":"2024-06-13T11:37:12.820785+0000","last_peered":"2024-06-13T11:37:12.820785+0000","last_clean":"2024-06-13T11:37:12.820785+0000","last_became_active":"2024-06-13T11:37:06.789419+0000","last_became_peered":"2024-06-13T11:37:06.789419+0000","last_unstale":"2024-06-13T11:37:12.820785+0000","last_undegraded":"2024-06-13T11:37:12.820785+0000","last_fullsized":"2024-06-13T11:37:12.820785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714261+0000","last_change":"2024-06-13T11:37:12.059420+0000","last_active":"2024-06-13T11:37:13.714261+0000","last_peered":"2024-06-13T11:37:13.714261+0000","last_clean":"2024-06-13T11:37:13.714261+0000","last_became_active":"2024-06-13T11:37:12.059035+0000","last_became_peered":"2024-06-13T11:37:12.059035+0000","last_unstale":"2024-06-13T11:37:13.714261+0000","last_undegraded":"2024-06-13T11:37:13.714261+0000","last_fullsized":"2024-06-13T11:37:13.714261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:47:04.312331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152626+0000","last_change":"2024-06-13T11:37:07.823057+0000","last_active":"2024-06-13T11:37:13.152626+0000","last_peered":"2024-06-13T11:37:13.152626+0000","last_clean":"2024-06-13T11:37:13.152626+0000","last_became_active":"2024-06-13T11:37:07.821414+0000","last_became_peered":"2024-06-13T11:37:07.821414+0000","last_unstale":"2024-06-13T11:37:13.152626+0000","last_undegraded":"2024-06-13T11:37:13.152626+0000","last_fullsized":"2024-06-13T11:37:13.152626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168391+0000","last_change":"2024-06-13T11:37:06.805846+0000","last_active":"2024-06-13T11:37:13.168391+0000","last_peered":"2024-06-13T11:37:13.168391+0000","last_clean":"2024-06-13T11:37:13.168391+0000","last_became_active":"2024-06-13T11:37:06.803100+0000","last_became_peered":"2024-06-13T11:37:06.803100+0000","last_unstale":"2024-06-13T11:37:13.168391+0000","last_undegraded":"2024-06-13T11:37:13.168391+0000","last_fullsized":"2024-06-13T11:37:13.168391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:36.725938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714058+0000","last_change":"2024-06-13T11:37:12.055700+0000","last_active":"2024-06-13T11:37:13.714058+0000","last_peered":"2024-06-13T11:37:13.714058+0000","last_clean":"2024-06-13T11:37:13.714058+0000","last_became_active":"2024-06-13T11:37:12.055159+0000","last_became_peered":"2024-06-13T11:37:12.055159+0000","last_unstale":"2024-06-13T11:37:13.714058+0000","last_undegraded":"2024-06-13T11:37:13.714058+0000","last_fullsized":"2024-06-13T11:37:13.714058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:55:00.012631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713171+0000","last_change":"2024-06-13T11:37:07.806718+0000","last_active":"2024-06-13T11:37:13.713171+0000","last_peered":"2024-06-13T11:37:13.713171+0000","last_clean":"2024-06-13T11:37:13.713171+0000","last_became_active":"2024-06-13T11:37:07.806243+0000","last_became_peered":"2024-06-13T11:37:07.806243+0000","last_unstale":"2024-06-13T11:37:13.713171+0000","last_undegraded":"2024-06-13T11:37:13.713171+0000","last_fullsized":"2024-06-13T11:37:13.713171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:44:45.438582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713668+0000","last_change":"2024-06-13T11:37:06.798091+0000","last_active":"2024-06-13T11:37:13.713668+0000","last_peered":"2024-06-13T11:37:13.713668+0000","last_clean":"2024-06-13T11:37:13.713668+0000","last_became_active":"2024-06-13T11:37:06.797712+0000","last_became_peered":"2024-06-13T11:37:06.797712+0000","last_unstale":"2024-06-13T11:37:13.713668+0000","last_undegraded":"2024-06-13T11:37:13.713668+0000","last_fullsized":"2024-06-13T11:37:13.713668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168678+0000","last_change":"2024-06-13T11:37:12.056862+0000","last_active":"2024-06-13T11:37:13.168678+0000","last_peered":"2024-06-13T11:37:13.168678+0000","last_clean":"2024-06-13T11:37:13.168678+0000","last_became_active":"2024-06-13T11:37:12.056394+0000","last_became_peered":"2024-06-13T11:37:12.056394+0000","last_unstale":"2024-06-13T11:37:13.168678+0000","last_undegraded":"2024-06-13T11:37:13.168678+0000","last_fullsized":"2024-06-13T11:37:13.168678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:30:32.045207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152808+0000","last_change":"2024-06-13T11:37:07.816795+0000","last_active":"2024-06-13T11:37:13.152808+0000","last_peered":"2024-06-13T11:37:13.152808+0000","last_clean":"2024-06-13T11:37:13.152808+0000","last_became_active":"2024-06-13T11:37:07.816480+0000","last_became_peered":"2024-06-13T11:37:07.816480+0000","last_unstale":"2024-06-13T11:37:13.152808+0000","last_undegraded":"2024-06-13T11:37:13.152808+0000","last_fullsized":"2024-06-13T11:37:13.152808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:17.399783+0000","last_change":"2024-06-13T11:37:06.793664+0000","last_active":"2024-06-13T11:37:17.399783+0000","last_peered":"2024-06-13T11:37:17.399783+0000","last_clean":"2024-06-13T11:37:17.399783+0000","last_became_active":"2024-06-13T11:37:06.793399+0000","last_became_peered":"2024-06-13T11:37:06.793399+0000","last_unstale":"2024-06-13T11:37:17.399783+0000","last_undegraded":"2024-06-13T11:37:17.399783+0000","last_fullsized":"2024-06-13T11:37:17.399783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819864+0000","last_change":"2024-06-13T11:37:11.840940+0000","last_active":"2024-06-13T11:37:12.819864+0000","last_peered":"2024-06-13T11:37:12.819864+0000","last_clean":"2024-06-13T11:37:12.819864+0000","last_became_active":"2024-06-13T11:37:11.840527+0000","last_became_peered":"2024-06-13T11:37:11.840527+0000","last_unstale":"2024-06-13T11:37:12.819864+0000","last_undegraded":"2024-06-13T11:37:12.819864+0000","last_fullsized":"2024-06-13T11:37:12.819864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821244+0000","last_change":"2024-06-13T11:37:07.810016+0000","last_active":"2024-06-13T11:37:12.821244+0000","last_peered":"2024-06-13T11:37:12.821244+0000","last_clean":"2024-06-13T11:37:12.821244+0000","last_became_active":"2024-06-13T11:37:07.809754+0000","last_became_peered":"2024-06-13T11:37:07.809754+0000","last_unstale":"2024-06-13T11:37:12.821244+0000","last_undegraded":"2024-06-13T11:37:12.821244+0000","last_fullsized":"2024-06-13T11:37:12.821244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:13.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820199+0000","last_change":"2024-06-13T11:37:06.802832+0000","last_active":"2024-06-13T11:37:12.820199+0000","last_peered":"2024-06-13T11:37:12.820199+0000","last_clean":"2024-06-13T11:37:12.820199+0000","last_became_active":"2024-06-13T11:37:06.802502+0000","last_became_peered":"2024-06-13T11:37:06.802502+0000","last_unstale":"2024-06-13T11:37:12.820199+0000","last_undegraded":"2024-06-13T11:37:12.820199+0000","last_fullsized":"2024-06-13T11:37:12.820199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819861+0000","last_change":"2024-06-13T11:37:11.842063+0000","last_active":"2024-06-13T11:37:12.819861+0000","last_peered":"2024-06-13T11:37:12.819861+0000","last_clean":"2024-06-13T11:37:12.819861+0000","last_became_active":"2024-06-13T11:37:11.841560+0000","last_became_peered":"2024-06-13T11:37:11.841560+0000","last_unstale":"2024-06-13T11:37:12.819861+0000","last_undegraded":"2024-06-13T11:37:12.819861+0000","last_fullsized":"2024-06-13T11:37:12.819861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:51.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713089+0000","last_change":"2024-06-13T11:37:07.816725+0000","last_active":"2024-06-13T11:37:13.713089+0000","last_peered":"2024-06-13T11:37:13.713089+0000","last_clean":"2024-06-13T11:37:13.713089+0000","last_became_active":"2024-06-13T11:37:07.816381+0000","last_became_peered":"2024-06-13T11:37:07.816381+0000","last_unstale":"2024-06-13T11:37:13.713089+0000","last_undegraded":"2024-06-13T11:37:13.713089+0000","last_fullsized":"2024-06-13T11:37:13.713089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168737+0000","last_change":"2024-06-13T11:37:06.804917+0000","last_active":"2024-06-13T11:37:13.168737+0000","last_peered":"2024-06-13T11:37:13.168737+0000","last_clean":"2024-06-13T11:37:13.168737+0000","last_became_active":"2024-06-13T11:37:06.804193+0000","last_became_peered":"2024-06-13T11:37:06.804193+0000","last_unstale":"2024-06-13T11:37:13.168737+0000","last_undegraded":"2024-06-13T11:37:13.168737+0000","last_fullsized":"2024-06-13T11:37:13.168737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:28.538858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712516+0000","last_change":"2024-06-13T11:37:11.842840+0000","last_active":"2024-06-13T11:37:13.712516+0000","last_peered":"2024-06-13T11:37:13.712516+0000","last_clean":"2024-06-13T11:37:13.712516+0000","last_became_active":"2024-06-13T11:37:11.842012+0000","last_became_peered":"2024-06-13T11:37:11.842012+0000","last_unstale":"2024-06-13T11:37:13.712516+0000","last_undegraded":"2024-06-13T11:37:13.712516+0000","last_fullsized":"2024-06-13T11:37:13.712516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:55.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168668+0000","last_change":"2024-06-13T11:37:07.814121+0000","last_active":"2024-06-13T11:37:13.168668+0000","last_peered":"2024-06-13T11:37:13.168668+0000","last_clean":"2024-06-13T11:37:13.168668+0000","last_became_active":"2024-06-13T11:37:07.813843+0000","last_became_peered":"2024-06-13T11:37:07.813843+0000","last_unstale":"2024-06-13T11:37:13.168668+0000","last_undegraded":"2024-06-13T11:37:13.168668+0000","last_fullsized":"2024-06-13T11:37:13.168668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821122+0000","last_change":"2024-06-13T11:37:06.803877+0000","last_active":"2024-06-13T11:37:12.821122+0000","last_peered":"2024-06-13T11:37:12.821122+0000","last_clean":"2024-06-13T11:37:12.821122+0000","last_became_active":"2024-06-13T11:37:06.803562+0000","last_became_peered":"2024-06-13T11:37:06.803562+0000","last_unstale":"2024-06-13T11:37:12.821122+0000","last_undegraded":"2024-06-13T11:37:12.821122+0000","last_fullsized":"2024-06-13T11:37:12.821122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713551+0000","last_change":"2024-06-13T11:37:12.055863+0000","last_active":"2024-06-13T11:37:13.713551+0000","last_peered":"2024-06-13T11:37:13.713551+0000","last_clean":"2024-06-13T11:37:13.713551+0000","last_became_active":"2024-06-13T11:37:12.055240+0000","last_became_peered":"2024-06-13T11:37:12.055240+0000","last_unstale":"2024-06-13T11:37:13.713551+0000","last_undegraded":"2024-06-13T11:37:13.713551+0000","last_fullsized":"2024-06-13T11:37:13.713551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:00.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712723+0000","last_change":"2024-06-13T11:37:12.059446+0000","last_active":"2024-06-13T11:37:13.712723+0000","last_peered":"2024-06-13T11:37:13.712723+0000","last_clean":"2024-06-13T11:37:13.712723+0000","last_became_active":"2024-06-13T11:37:12.057697+0000","last_became_peered":"2024-06-13T11:37:12.057697+0000","last_unstale":"2024-06-13T11:37:13.712723+0000","last_undegraded":"2024-06-13T11:37:13.712723+0000","last_fullsized":"2024-06-13T11:37:13.712723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819164+0000","last_change":"2024-06-13T11:37:07.814989+0000","last_active":"2024-06-13T11:37:12.819164+0000","last_peered":"2024-06-13T11:37:12.819164+0000","last_clean":"2024-06-13T11:37:12.819164+0000","last_became_active":"2024-06-13T11:37:07.814564+0000","last_became_peered":"2024-06-13T11:37:07.814564+0000","last_unstale":"2024-06-13T11:37:12.819164+0000","last_undegraded":"2024-06-13T11:37:12.819164+0000","last_fullsized":"2024-06-13T11:37:12.819164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168310+0000","last_change":"2024-06-13T11:37:06.802741+0000","last_active":"2024-06-13T11:37:13.168310+0000","last_peered":"2024-06-13T11:37:13.168310+0000","last_clean":"2024-06-13T11:37:13.168310+0000","last_became_active":"2024-06-13T11:37:06.802409+0000","last_became_peered":"2024-06-13T11:37:06.802409+0000","last_unstale":"2024-06-13T11:37:13.168310+0000","last_undegraded":"2024-06-13T11:37:13.168310+0000","last_fullsized":"2024-06-13T11:37:13.168310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:05:54.761290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819943+0000","last_change":"2024-06-13T11:37:11.841003+0000","last_active":"2024-06-13T11:37:12.819943+0000","last_peered":"2024-06-13T11:37:12.819943+0000","last_clean":"2024-06-13T11:37:12.819943+0000","last_became_active":"2024-06-13T11:37:11.840537+0000","last_became_peered":"2024-06-13T11:37:11.840537+0000","last_unstale":"2024-06-13T11:37:12.819943+0000","last_undegraded":"2024-06-13T11:37:12.819943+0000","last_fullsized":"2024-06-13T11:37:12.819943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:16:14.249413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712613+0000","last_change":"2024-06-13T11:37:07.814236+0000","last_active":"2024-06-13T11:37:13.712613+0000","last_peered":"2024-06-13T11:37:13.712613+0000","last_clean":"2024-06-13T11:37:13.712613+0000","last_became_active":"2024-06-13T11:37:07.813951+0000","last_became_peered":"2024-06-13T11:37:07.813951+0000","last_unstale":"2024-06-13T11:37:13.712613+0000","last_undegraded":"2024-06-13T11:37:13.712613+0000","last_fullsized":"2024-06-13T11:37:13.712613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713871+0000","last_change":"2024-06-13T11:37:06.793599+0000","last_active":"2024-06-13T11:37:13.713871+0000","last_peered":"2024-06-13T11:37:13.713871+0000","last_clean":"2024-06-13T11:37:13.713871+0000","last_became_active":"2024-06-13T11:37:06.793280+0000","last_became_peered":"2024-06-13T11:37:06.793280+0000","last_unstale":"2024-06-13T11:37:13.713871+0000","last_undegraded":"2024-06-13T11:37:13.713871+0000","last_fullsized":"2024-06-13T11:37:13.713871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821282+0000","last_change":"2024-06-13T11:37:06.794432+0000","last_active":"2024-06-13T11:37:12.821282+0000","last_peered":"2024-06-13T11:37:12.821282+0000","last_clean":"2024-06-13T11:37:12.821282+0000","last_became_active":"2024-06-13T11:37:06.794119+0000","last_became_peered":"2024-06-13T11:37:06.794119+0000","last_unstale":"2024-06-13T11:37:12.821282+0000","last_undegraded":"2024-06-13T11:37:12.821282+0000","last_fullsized":"2024-06-13T11:37:12.821282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713576+0000","last_change":"2024-06-13T11:37:07.809910+0000","last_active":"2024-06-13T11:37:13.713576+0000","last_peered":"2024-06-13T11:37:13.713576+0000","last_clean":"2024-06-13T11:37:13.713576+0000","last_became_active":"2024-06-13T11:37:07.809587+0000","last_became_peered":"2024-06-13T11:37:07.809587+0000","last_unstale":"2024-06-13T11:37:13.713576+0000","last_undegraded":"2024-06-13T11:37:13.713576+0000","last_fullsized":"2024-06-13T11:37:13.713576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712785+0000","last_change":"2024-06-13T11:37:11.832051+0000","last_active":"2024-06-13T11:37:13.712785+0000","last_peered":"2024-06-13T11:37:13.712785+0000","last_clean":"2024-06-13T11:37:13.712785+0000","last_became_active":"2024-06-13T11:37:11.831633+0000","last_became_peered":"2024-06-13T11:37:11.831633+0000","last_unstale":"2024-06-13T11:37:13.712785+0000","last_undegraded":"2024-06-13T11:37:13.712785+0000","last_fullsized":"2024-06-13T11:37:13.712785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:03:22.884367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713873+0000","last_change":"2024-06-13T11:37:06.797052+0000","last_active":"2024-06-13T11:37:13.713873+0000","last_peered":"2024-06-13T11:37:13.713873+0000","last_clean":"2024-06-13T11:37:13.713873+0000","last_became_active":"2024-06-13T11:37:06.796723+0000","last_became_peered":"2024-06-13T11:37:06.796723+0000","last_unstale":"2024-06-13T11:37:13.713873+0000","last_undegraded":"2024-06-13T11:37:13.713873+0000","last_fullsized":"2024-06-13T11:37:13.713873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819596+0000","last_change":"2024-06-13T11:37:07.805771+0000","last_active":"2024-06-13T11:37:12.819596+0000","last_peered":"2024-06-13T11:37:12.819596+0000","last_clean":"2024-06-13T11:37:12.819596+0000","last_became_active":"2024-06-13T11:37:07.805463+0000","last_became_peered":"2024-06-13T11:37:07.805463+0000","last_unstale":"2024-06-13T11:37:12.819596+0000","last_undegraded":"2024-06-13T11:37:12.819596+0000","last_fullsized":"2024-06-13T11:37:12.819596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:44.456986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713722+0000","last_change":"2024-06-13T11:37:11.841035+0000","last_active":"2024-06-13T11:37:13.713722+0000","last_peered":"2024-06-13T11:37:13.713722+0000","last_clean":"2024-06-13T11:37:13.713722+0000","last_became_active":"2024-06-13T11:37:11.840626+0000","last_became_peered":"2024-06-13T11:37:11.840626+0000","last_unstale":"2024-06-13T11:37:13.713722+0000","last_undegraded":"2024-06-13T11:37:13.713722+0000","last_fullsized":"2024-06-13T11:37:13.713722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:32:57.521991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820017+0000","last_change":"2024-06-13T11:37:07.816052+0000","last_active":"2024-06-13T11:37:12.820017+0000","last_peered":"2024-06-13T11:37:12.820017+0000","last_clean":"2024-06-13T11:37:12.820017+0000","last_became_active":"2024-06-13T11:37:07.815407+0000","last_became_peered":"2024-06-13T11:37:07.815407+0000","last_unstale":"2024-06-13T11:37:12.820017+0000","last_undegraded":"2024-06-13T11:37:12.820017+0000","last_fullsized":"2024-06-13T11:37:12.820017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712280+0000","last_change":"2024-06-13T11:37:07.813338+0000","last_active":"2024-06-13T11:37:13.712280+0000","last_peered":"2024-06-13T11:37:13.712280+0000","last_clean":"2024-06-13T11:37:13.712280+0000","last_became_active":"2024-06-13T11:37:07.813058+0000","last_became_peered":"2024-06-13T11:37:07.813058+0000","last_unstale":"2024-06-13T11:37:13.712280+0000","last_undegraded":"2024-06-13T11:37:13.712280+0000","last_fullsized":"2024-06-13T11:37:13.712280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:04.020273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168311+0000","last_change":"2024-06-13T11:37:07.814579+0000","last_active":"2024-06-13T11:37:13.168311+0000","last_peered":"2024-06-13T11:37:13.168311+0000","last_clean":"2024-06-13T11:37:13.168311+0000","last_became_active":"2024-06-13T11:37:07.814287+0000","last_became_peered":"2024-06-13T11:37:07.814287+0000","last_unstale":"2024-06-13T11:37:13.168311+0000","last_undegraded":"2024-06-13T11:37:13.168311+0000","last_fullsized":"2024-06-13T11:37:13.168311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713460+0000","last_change":"2024-06-13T11:37:07.812453+0000","last_active":"2024-06-13T11:37:13.713460+0000","last_peered":"2024-06-13T11:37:13.713460+0000","last_clean":"2024-06-13T11:37:13.713460+0000","last_became_active":"2024-06-13T11:37:07.812179+0000","last_became_peered":"2024-06-13T11:37:07.812179+0000","last_unstale":"2024-06-13T11:37:13.713460+0000","last_undegraded":"2024-06-13T11:37:13.713460+0000","last_fullsized":"2024-06-13T11:37:13.713460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714168+0000","last_change":"2024-06-13T11:37:07.809534+0000","last_active":"2024-06-13T11:37:13.714168+0000","last_peered":"2024-06-13T11:37:13.714168+0000","last_clean":"2024-06-13T11:37:13.714168+0000","last_became_active":"2024-06-13T11:37:07.809238+0000","last_became_peered":"2024-06-13T11:37:07.809238+0000","last_unstale":"2024-06-13T11:37:13.714168+0000","last_undegraded":"2024-06-13T11:37:13.714168+0000","last_fullsized":"2024-06-13T11:37:13.714168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:16:41.866755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819893+0000","last_change":"2024-06-13T11:37:07.818257+0000","last_active":"2024-06-13T11:37:12.819893+0000","last_peered":"2024-06-13T11:37:12.819893+0000","last_clean":"2024-06-13T11:37:12.819893+0000","last_became_active":"2024-06-13T11:37:07.817910+0000","last_became_peered":"2024-06-13T11:37:07.817910+0000","last_unstale":"2024-06-13T11:37:12.819893+0000","last_undegraded":"2024-06-13T11:37:12.819893+0000","last_fullsized":"2024-06-13T11:37:12.819893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821518+0000","last_change":"2024-06-13T11:37:07.810465+0000","last_active":"2024-06-13T11:37:12.821518+0000","last_peered":"2024-06-13T11:37:12.821518+0000","last_clean":"2024-06-13T11:37:12.821518+0000","last_became_active":"2024-06-13T11:37:07.810018+0000","last_became_peered":"2024-06-13T11:37:07.810018+0000","last_unstale":"2024-06-13T11:37:12.821518+0000","last_undegraded":"2024-06-13T11:37:12.821518+0000","last_fullsized":"2024-06-13T11:37:12.821518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714221+0000","last_change":"2024-06-13T11:37:07.807899+0000","last_active":"2024-06-13T11:37:13.714221+0000","last_peered":"2024-06-13T11:37:13.714221+0000","last_clean":"2024-06-13T11:37:13.714221+0000","last_became_active":"2024-06-13T11:37:07.807583+0000","last_became_peered":"2024-06-13T11:37:07.807583+0000","last_unstale":"2024-06-13T11:37:13.714221+0000","last_undegraded":"2024-06-13T11:37:13.714221+0000","last_fullsized":"2024-06-13T11:37:13.714221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:11.241283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168187+0000","last_change":"2024-06-13T11:37:07.803581+0000","last_active":"2024-06-13T11:37:13.168187+0000","last_peered":"2024-06-13T11:37:13.168187+0000","last_clean":"2024-06-13T11:37:13.168187+0000","last_became_active":"2024-06-13T11:37:07.803152+0000","last_became_peered":"2024-06-13T11:37:07.803152+0000","last_unstale":"2024-06-13T11:37:13.168187+0000","last_undegraded":"2024-06-13T11:37:13.168187+0000","last_fullsized":"2024-06-13T11:37:13.168187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713706+0000","last_change":"2024-06-13T11:37:07.805036+0000","last_active":"2024-06-13T11:37:13.713706+0000","last_peered":"2024-06-13T11:37:13.713706+0000","last_clean":"2024-06-13T11:37:13.713706+0000","last_became_active":"2024-06-13T11:37:07.804074+0000","last_became_peered":"2024-06-13T11:37:07.804074+0000","last_unstale":"2024-06-13T11:37:13.713706+0000","last_undegraded":"2024-06-13T11:37:13.713706+0000","last_fullsized":"2024-06-13T11:37:13.713706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:32:19.911394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168271+0000","last_change":"2024-06-13T11:37:07.822794+0000","last_active":"2024-06-13T11:37:13.168271+0000","last_peered":"2024-06-13T11:37:13.168271+0000","last_clean":"2024-06-13T11:37:13.168271+0000","last_became_active":"2024-06-13T11:37:07.822476+0000","last_became_peered":"2024-06-13T11:37:07.822476+0000","last_unstale":"2024-06-13T11:37:13.168271+0000","last_undegraded":"2024-06-13T11:37:13.168271+0000","last_fullsized":"2024-06-13T11:37:13.168271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713222+0000","last_change":"2024-06-13T11:37:07.810639+0000","last_active":"2024-06-13T11:37:13.713222+0000","last_peered":"2024-06-13T11:37:13.713222+0000","last_clean":"2024-06-13T11:37:13.713222+0000","last_became_active":"2024-06-13T11:37:07.810285+0000","last_became_peered":"2024-06-13T11:37:07.810285+0000","last_unstale":"2024-06-13T11:37:13.713222+0000","last_undegraded":"2024-06-13T11:37:13.713222+0000","last_fullsized":"2024-06-13T11:37:13.713222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821000+0000","last_change":"2024-06-13T11:37:07.804880+0000","last_active":"2024-06-13T11:37:12.821000+0000","last_peered":"2024-06-13T11:37:12.821000+0000","last_clean":"2024-06-13T11:37:12.821000+0000","last_became_active":"2024-06-13T11:37:07.803451+0000","last_became_peered":"2024-06-13T11:37:07.803451+0000","last_unstale":"2024-06-13T11:37:12.821000+0000","last_undegraded":"2024-06-13T11:37:12.821000+0000","last_fullsized":"2024-06-13T11:37:12.821000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153125+0000","last_change":"2024-06-13T11:37:07.808713+0000","last_active":"2024-06-13T11:37:13.153125+0000","last_peered":"2024-06-13T11:37:13.153125+0000","last_clean":"2024-06-13T11:37:13.153125+0000","last_became_active":"2024-06-13T11:37:07.808422+0000","last_became_peered":"2024-06-13T11:37:07.808422+0000","last_unstale":"2024-06-13T11:37:13.153125+0000","last_undegraded":"2024-06-13T11:37:13.153125+0000","last_fullsized":"2024-06-13T11:37:13.153125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712358+0000","last_change":"2024-06-13T11:37:07.808193+0000","last_active":"2024-06-13T11:37:13.712358+0000","last_peered":"2024-06-13T11:37:13.712358+0000","last_clean":"2024-06-13T11:37:13.712358+0000","last_became_active":"2024-06-13T11:37:07.807809+0000","last_became_peered":"2024-06-13T11:37:07.807809+0000","last_unstale":"2024-06-13T11:37:13.712358+0000","last_undegraded":"2024-06-13T11:37:13.712358+0000","last_fullsized":"2024-06-13T11:37:13.712358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:08.966864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168884+0000","last_change":"2024-06-13T11:37:07.826457+0000","last_active":"2024-06-13T11:37:13.168884+0000","last_peered":"2024-06-13T11:37:13.168884+0000","last_clean":"2024-06-13T11:37:13.168884+0000","last_became_active":"2024-06-13T11:37:07.826150+0000","last_became_peered":"2024-06-13T11:37:07.826150+0000","last_unstale":"2024-06-13T11:37:13.168884+0000","last_undegraded":"2024-06-13T11:37:13.168884+0000","last_fullsized":"2024-06-13T11:37:13.168884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168030+0000","last_change":"2024-06-13T11:37:07.817291+0000","last_active":"2024-06-13T11:37:13.168030+0000","last_peered":"2024-06-13T11:37:13.168030+0000","last_clean":"2024-06-13T11:37:13.168030+0000","last_became_active":"2024-06-13T11:37:07.817016+0000","last_became_peered":"2024-06-13T11:37:07.817016+0000","last_unstale":"2024-06-13T11:37:13.168030+0000","last_undegraded":"2024-06-13T11:37:13.168030+0000","last_fullsized":"2024-06-13T11:37:13.168030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:10.222966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819296+0000","last_change":"2024-06-13T11:37:07.807833+0000","last_active":"2024-06-13T11:37:12.819296+0000","last_peered":"2024-06-13T11:37:12.819296+0000","last_clean":"2024-06-13T11:37:12.819296+0000","last_became_active":"2024-06-13T11:37:07.807536+0000","last_became_peered":"2024-06-13T11:37:07.807536+0000","last_unstale":"2024-06-13T11:37:12.819296+0000","last_undegraded":"2024-06-13T11:37:12.819296+0000","last_fullsized":"2024-06-13T11:37:12.819296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713077+0000","last_change":"2024-06-13T11:37:07.809789+0000","last_active":"2024-06-13T11:37:13.713077+0000","last_peered":"2024-06-13T11:37:13.713077+0000","last_clean":"2024-06-13T11:37:13.713077+0000","last_became_active":"2024-06-13T11:37:07.809493+0000","last_became_peered":"2024-06-13T11:37:07.809493+0000","last_unstale":"2024-06-13T11:37:13.713077+0000","last_undegraded":"2024-06-13T11:37:13.713077+0000","last_fullsized":"2024-06-13T11:37:13.713077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:00.616643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713659+0000","last_change":"2024-06-13T11:37:07.808038+0000","last_active":"2024-06-13T11:37:13.713659+0000","last_peered":"2024-06-13T11:37:13.713659+0000","last_clean":"2024-06-13T11:37:13.713659+0000","last_became_active":"2024-06-13T11:37:07.807727+0000","last_became_peered":"2024-06-13T11:37:07.807727+0000","last_unstale":"2024-06-13T11:37:13.713659+0000","last_undegraded":"2024-06-13T11:37:13.713659+0000","last_fullsized":"2024-06-13T11:37:13.713659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821132+0000","last_change":"2024-06-13T11:37:07.807879+0000","last_active":"2024-06-13T11:37:12.821132+0000","last_peered":"2024-06-13T11:37:12.821132+0000","last_clean":"2024-06-13T11:37:12.821132+0000","last_became_active":"2024-06-13T11:37:07.807538+0000","last_became_peered":"2024-06-13T11:37:07.807538+0000","last_unstale":"2024-06-13T11:37:12.821132+0000","last_undegraded":"2024-06-13T11:37:12.821132+0000","last_fullsized":"2024-06-13T11:37:12.821132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:33.935198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821182+0000","last_change":"2024-06-13T11:37:07.809717+0000","last_active":"2024-06-13T11:37:12.821182+0000","last_peered":"2024-06-13T11:37:12.821182+0000","last_clean":"2024-06-13T11:37:12.821182+0000","last_became_active":"2024-06-13T11:37:07.809444+0000","last_became_peered":"2024-06-13T11:37:07.809444+0000","last_unstale":"2024-06-13T11:37:12.821182+0000","last_undegraded":"2024-06-13T11:37:12.821182+0000","last_fullsized":"2024-06-13T11:37:12.821182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821499+0000","last_change":"2024-06-13T11:37:07.810594+0000","last_active":"2024-06-13T11:37:12.821499+0000","last_peered":"2024-06-13T11:37:12.821499+0000","last_clean":"2024-06-13T11:37:12.821499+0000","last_became_active":"2024-06-13T11:37:07.810177+0000","last_became_peered":"2024-06-13T11:37:07.810177+0000","last_unstale":"2024-06-13T11:37:12.821499+0000","last_undegraded":"2024-06-13T11:37:12.821499+0000","last_fullsized":"2024-06-13T11:37:12.821499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153218+0000","last_change":"2024-06-13T11:37:07.824727+0000","last_active":"2024-06-13T11:37:13.153218+0000","last_peered":"2024-06-13T11:37:13.153218+0000","last_clean":"2024-06-13T11:37:13.153218+0000","last_became_active":"2024-06-13T11:37:07.824440+0000","last_became_peered":"2024-06-13T11:37:07.824440+0000","last_unstale":"2024-06-13T11:37:13.153218+0000","last_undegraded":"2024-06-13T11:37:13.153218+0000","last_fullsized":"2024-06-13T11:37:13.153218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712370+0000","last_change":"2024-06-13T11:37:07.811181+0000","last_active":"2024-06-13T11:37:13.712370+0000","last_peered":"2024-06-13T11:37:13.712370+0000","last_clean":"2024-06-13T11:37:13.712370+0000","last_became_active":"2024-06-13T11:37:07.810827+0000","last_became_peered":"2024-06-13T11:37:07.810827+0000","last_unstale":"2024-06-13T11:37:13.712370+0000","last_undegraded":"2024-06-13T11:37:13.712370+0000","last_fullsized":"2024-06-13T11:37:13.712370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152419+0000","last_change":"2024-06-13T11:37:07.817006+0000","last_active":"2024-06-13T11:37:13.152419+0000","last_peered":"2024-06-13T11:37:13.152419+0000","last_clean":"2024-06-13T11:37:13.152419+0000","last_became_active":"2024-06-13T11:37:07.816608+0000","last_became_peered":"2024-06-13T11:37:07.816608+0000","last_unstale":"2024-06-13T11:37:13.152419+0000","last_undegraded":"2024-06-13T11:37:13.152419+0000","last_fullsized":"2024-06-13T11:37:13.152419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168151+0000","last_change":"2024-06-13T11:37:07.816639+0000","last_active":"2024-06-13T11:37:13.168151+0000","last_peered":"2024-06-13T11:37:13.168151+0000","last_clean":"2024-06-13T11:37:13.168151+0000","last_became_active":"2024-06-13T11:37:07.816347+0000","last_became_peered":"2024-06-13T11:37:07.816347+0000","last_unstale":"2024-06-13T11:37:13.168151+0000","last_undegraded":"2024-06-13T11:37:13.168151+0000","last_fullsized":"2024-06-13T11:37:13.168151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:28:30.350625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152445+0000","last_change":"2024-06-13T11:37:07.818920+0000","last_active":"2024-06-13T11:37:13.152445+0000","last_peered":"2024-06-13T11:37:13.152445+0000","last_clean":"2024-06-13T11:37:13.152445+0000","last_became_active":"2024-06-13T11:37:07.818628+0000","last_became_peered":"2024-06-13T11:37:07.818628+0000","last_unstale":"2024-06-13T11:37:13.152445+0000","last_undegraded":"2024-06-13T11:37:13.152445+0000","last_fullsized":"2024-06-13T11:37:13.152445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168341+0000","last_change":"2024-06-13T11:37:07.812235+0000","last_active":"2024-06-13T11:37:13.168341+0000","last_peered":"2024-06-13T11:37:13.168341+0000","last_clean":"2024-06-13T11:37:13.168341+0000","last_became_active":"2024-06-13T11:37:07.811740+0000","last_became_peered":"2024-06-13T11:37:07.811740+0000","last_unstale":"2024-06-13T11:37:13.168341+0000","last_undegraded":"2024-06-13T11:37:13.168341+0000","last_fullsized":"2024-06-13T11:37:13.168341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:24:14.572925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712830+0000","last_change":"2024-06-13T11:37:07.810203+0000","last_active":"2024-06-13T11:37:13.712830+0000","last_peered":"2024-06-13T11:37:13.712830+0000","last_clean":"2024-06-13T11:37:13.712830+0000","last_became_active":"2024-06-13T11:37:07.809607+0000","last_became_peered":"2024-06-13T11:37:07.809607+0000","last_unstale":"2024-06-13T11:37:13.712830+0000","last_undegraded":"2024-06-13T11:37:13.712830+0000","last_fullsized":"2024-06-13T11:37:13.712830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820323+0000","last_change":"2024-06-13T11:37:07.815528+0000","last_active":"2024-06-13T11:37:12.820323+0000","last_peered":"2024-06-13T11:37:12.820323+0000","last_clean":"2024-06-13T11:37:12.820323+0000","last_became_active":"2024-06-13T11:37:07.815240+0000","last_became_peered":"2024-06-13T11:37:07.815240+0000","last_unstale":"2024-06-13T11:37:12.820323+0000","last_undegraded":"2024-06-13T11:37:12.820323+0000","last_fullsized":"2024-06-13T11:37:12.820323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153117+0000","last_change":"2024-06-13T11:37:07.822539+0000","last_active":"2024-06-13T11:37:13.153117+0000","last_peered":"2024-06-13T11:37:13.153117+0000","last_clean":"2024-06-13T11:37:13.153117+0000","last_became_active":"2024-06-13T11:37:07.820878+0000","last_became_peered":"2024-06-13T11:37:07.820878+0000","last_unstale":"2024-06-13T11:37:13.153117+0000","last_undegraded":"2024-06-13T11:37:13.153117+0000","last_fullsized":"2024-06-13T11:37:13.153117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:51.638079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":694641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":103781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":103817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":105303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":103691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":103851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":694697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:37:22.228 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-13T11:37:22.228 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-13T11:37:22.228 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-13T11:37:22.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-13T11:37:22.229 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-13T11:37:22.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.369+0000 7fc7e83b7640 1 Processor -- start 2024-06-13T11:37:22.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.369+0000 7fc7e83b7640 1 -- start start 2024-06-13T11:37:22.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e83b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7e0147260 0x7fc7e00cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e83b7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e00cffa0 con 0x7fc7e0147920 2024-06-13T11:37:22.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e83b7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e00d0280 con 0x7fc7e00d1380 2024-06-13T11:37:22.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e83b7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e0071a60 con 0x7fc7e0147260 2024-06-13T11:37:22.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e5952640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc7e0147920 0x7fc7e00d0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45074/0 (socket says 172.21.15.43:45074) 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e5952640 1 -- 172.21.15.43:0/894797736 learned_addr learned my addr 172.21.15.43:0/894797736 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722122641 0 0) 0x7fc7e00cffa0 con 0x7fc7e0147920 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e6153640 1 --2- 172.21.15.43:0/894797736 >> v2:172.21.15.53:3300/0 conn(0x7fc7e0147260 0x7fc7e00cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.370+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7cc003520 con 0x7fc7e0147920 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2988454556 0 0) 0x7fc7cc003520 con 0x7fc7e0147920 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 >> v2:172.21.15.53:3300/0 conn(0x7fc7e0147260 msgr2=0x7fc7e00cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 --2- 172.21.15.43:0/894797736 >> v2:172.21.15.53:3300/0 conn(0x7fc7e0147260 0x7fc7e00cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 >> v1:172.21.15.53:6789/0 conn(0x7fc7e00d1380 legacy=0x7fc7e0072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e0071d40 con 0x7fc7e0147920 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fc7d0001670 con 0x7fc7e0147920 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 >> v1:172.21.15.43:6789/0 conn(0x7fc7e0147920 legacy=0x7fc7e00d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0039b0 0x7fc7cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc004800 0x7fc7cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc0051c0 0x7fc7cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e0071a60 con 0x7fc7cc0051c0 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc00c060 con 0x7fc7cc004800 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc7cc00c260 con 0x7fc7cc0039b0 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e5952640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc004800 0x7fc7cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6153640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0039b0 0x7fc7cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6954640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc0051c0 0x7fc7cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6954640 1 -- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0039b0 msgr2=0x7fc7cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6954640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0039b0 0x7fc7cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6954640 1 -- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc004800 msgr2=0x7fc7cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6954640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc004800 0x7fc7cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6954640 1 -- 172.21.15.43:0/894797736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc003520 con 0x7fc7cc0051c0 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.371+0000 7fc7e6153640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0039b0 0x7fc7cc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.372+0000 7fc7e6954640 1 -- 172.21.15.43:0/894797736 reap_dead start 2024-06-13T11:37:22.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.372+0000 7fc7e6954640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc0051c0 0x7fc7cc00b9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8001e50 tx=0x7fc7cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c29a43b73489a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.372+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc009690 con 0x7fc7cc0051c0 2024-06-13T11:37:22.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.372+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d8003970 con 0x7fc7cc0051c0 2024-06-13T11:37:22.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.372+0000 7fc7e5151640 1 -- 172.21.15.43:0/894797736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8001a70 con 0x7fc7cc0051c0 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 -- 172.21.15.43:0/894797736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc0051c0 msgr2=0x7fc7cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc0051c0 0x7fc7cc00b9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8001e50 tx=0x7fc7cc005830 comp rx=0 tx=0).stop 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 -- 172.21.15.43:0/894797736 shutdown_connections 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/894797736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc0051c0 0x7fc7cc00b9c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 -- 172.21.15.43:0/894797736 >> 172.21.15.43:0/894797736 conn(0x7fc7e0070810 msgr2=0x7fc7e0070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 -- 172.21.15.43:0/894797736 shutdown_connections 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.373+0000 7fc7e83b7640 1 -- 172.21.15.43:0/894797736 wait complete. 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.374+0000 7fc7e83b7640 1 Processor -- start 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.374+0000 7fc7e83b7640 1 -- start start 2024-06-13T11:37:22.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e83b7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0051c0 0x7fc7e0142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e83b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 0x7fc7e00b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e83b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e015df60 0x7fc7e015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e83b7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e00cf9d0 con 0x7fc7e00b2810 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e83b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e00cf850 con 0x7fc7e015df60 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e83b7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e00cfb50 con 0x7fc7cc0051c0 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 0x7fc7e00b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 0x7fc7e00b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36454/0 (socket says 172.21.15.43:36454) 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 -- 172.21.15.43:0/2787450406 learned_addr learned my addr 172.21.15.43:0/2787450406 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e6153640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0051c0 0x7fc7e0142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e6954640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e015df60 0x7fc7e015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 -- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0051c0 msgr2=0x7fc7e0142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0051c0 0x7fc7e0142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 -- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e015df60 msgr2=0x7fc7e015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e015df60 0x7fc7e015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 -- 172.21.15.43:0/2787450406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e015ec20 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.375+0000 7fc7e5952640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 0x7fc7e00b2c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00072c0 tx=0x7fc7d00076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.376+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d001a070 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.376+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d000f960 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.376+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e015ef00 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.376+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000fd50 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.376+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e015f4c0 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.377+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e004ffb0 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.377+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7d001d070 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.378+0000 7fc7d6ffd640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7c406be60 0x7fc7c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.378+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc7d008ab70 con 0x7fc7e00b2810 2024-06-13T11:37:22.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.378+0000 7fc7e6153640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7c406be60 0x7fc7c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.379+0000 7fc7e6153640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7c406be60 0x7fc7c406e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00b4b60 tx=0x7fc7dc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.382+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7d0058b90 con 0x7fc7e00b2810 2024-06-13T11:37:22.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.613+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc7e00b4570 con 0x7fc7e00b2810 2024-06-13T11:37:22.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.617+0000 7fc7d6ffd640 1 -- 172.21.15.43:0/2787450406 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172937 (secure 0 0 0) 0x7fc7d005ce90 con 0x7fc7e00b2810 2024-06-13T11:37:22.618 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7c406be60 msgr2=0x7fc7c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7c406be60 0x7fc7c406e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00b4b60 tx=0x7fc7dc009190 comp rx=0 tx=0).stop 2024-06-13T11:37:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 msgr2=0x7fc7e00b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 0x7fc7e00b2c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00072c0 tx=0x7fc7d00076c0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 shutdown_connections 2024-06-13T11:37:22.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7c406be60 0x7fc7c406e320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e015df60 0x7fc7e015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7e00b2810 0x7fc7e00b2c90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 --2- 172.21.15.43:0/2787450406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc0051c0 0x7fc7e0142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 >> 172.21.15.43:0/2787450406 conn(0x7fc7e0070810 msgr2=0x7fc7e00d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 shutdown_connections 2024-06-13T11:37:22.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.619+0000 7fc7e83b7640 1 -- 172.21.15.43:0/2787450406 wait complete. 2024-06-13T11:37:22.629 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3639668584},{"type":"v1","addr":"172.21.15.53:6833","nonce":3639668584}]},"active_addr":"172.21.15.53:6833/3639668584","active_change":"2024-06-13T11:36:55.341312+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":801637539}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":3726058521}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":999998883}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1002118442}]}]} 2024-06-13T11:37:22.632 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-13T11:37:22.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-13T11:37:22.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:22.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.736+0000 7f8a1f84c640 1 Processor -- start 2024-06-13T11:37:22.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.737+0000 7f8a1f84c640 1 -- start start 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1f84c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a180ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1f84c640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a180aa5d0 con 0x7f8a18155420 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1f84c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a180aeb90 con 0x7f8a180d2a90 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1f84c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a18155800 con 0x7f8a180d2f00 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1d5e8640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8a18155420 0x7f8a180ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45088/0 (socket says 172.21.15.43:45088) 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1d5e8640 1 -- 172.21.15.43:0/2243160517 learned_addr learned my addr 172.21.15.43:0/2243160517 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1dde9640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a180ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835035112 0 0) 0x7f8a180aa5d0 con 0x7f8a18155420 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a04003520 con 0x7f8a18155420 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701660386 0 0) 0x7f8a180aeb90 con 0x7f8a180d2a90 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a180aa5d0 con 0x7f8a180d2a90 2024-06-13T11:37:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3350206673 0 0) 0x7f8a04003520 con 0x7f8a18155420 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 msgr2=0x7f8a180ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a180ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 >> v1:172.21.15.53:6789/0 conn(0x7f8a180d2a90 legacy=0x7f8a180abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a180aa870 con 0x7f8a18155420 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f8a14001670 con 0x7f8a18155420 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1dde9640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a180ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 >> v1:172.21.15.43:6789/0 conn(0x7f8a18155420 legacy=0x7f8a180ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a04003b70 0x7f8a04003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18155800 con 0x7f8a04004800 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0400b9f0 con 0x7f8a04003b70 2024-06-13T11:37:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0400bbf0 con 0x7f8a180d2f00 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1d5e8640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a04003b70 0x7f8a04003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.738+0000 7f8a1dde9640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.739+0000 7f8a1cde7640 1 -- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 msgr2=0x7f8a040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.739+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a180d2f00 0x7f8a040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.739+0000 7f8a1cde7640 1 -- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a04003b70 msgr2=0x7f8a04003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.739+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a04003b70 0x7f8a04003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.739+0000 7f8a1cde7640 1 -- 172.21.15.43:0/2243160517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a04003520 con 0x7f8a04004800 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.739+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a080018a0 tx=0x7f8a04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c166b245f4ec6f75 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a080014f0 con 0x7f8a04004800 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a080052d0 con 0x7f8a04004800 2024-06-13T11:37:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a0ffff640 1 -- 172.21.15.43:0/2243160517 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0802ac40 con 0x7f8a04004800 2024-06-13T11:37:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1f84c640 1 -- 172.21.15.43:0/2243160517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 msgr2=0x7f8a04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/2243160517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a080018a0 tx=0x7f8a04005830 comp rx=0 tx=0).stop 2024-06-13T11:37:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1dde9640 1 -- 172.21.15.43:0/2243160517 reap_dead start 2024-06-13T11:37:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1f84c640 1 -- 172.21.15.43:0/2243160517 shutdown_connections 2024-06-13T11:37:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1f84c640 1 -- 172.21.15.43:0/2243160517 >> 172.21.15.43:0/2243160517 conn(0x7f8a18067640 msgr2=0x7f8a180d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1f84c640 1 -- 172.21.15.43:0/2243160517 shutdown_connections 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.740+0000 7f8a1f84c640 1 -- 172.21.15.43:0/2243160517 wait complete. 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.741+0000 7f8a1f84c640 1 Processor -- start 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 -- start start 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a1814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a180b0160 0x7f8a180b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a181578c0 0x7f8a18157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a180ab110 con 0x7f8a04004800 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a180aae30 con 0x7f8a180b0160 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1f84c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a180d3340 con 0x7f8a181578c0 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1d5e8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a1814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1d5e8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a1814aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36468/0 (socket says 172.21.15.43:36468) 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1d5e8640 1 -- 172.21.15.43:0/1394426377 learned_addr learned my addr 172.21.15.43:0/1394426377 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1dde9640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a181578c0 0x7f8a18157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.742+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a180b0160 0x7f8a180b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1d5e8640 1 -- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a181578c0 msgr2=0x7f8a18157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1d5e8640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a181578c0 0x7f8a18157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1d5e8640 1 -- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a180b0160 msgr2=0x7f8a180b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1d5e8640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a180b0160 0x7f8a180b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1d5e8640 1 -- 172.21.15.43:0/1394426377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a180b0c20 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1d5e8640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a1814aa00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a14007340 tx=0x7f8a14007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400f860 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14018070 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a180b0f00 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400fc40 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.743+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a180b14c0 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.744+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a180b17f0 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.745+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a1401d460 con 0x7f8a04004800 2024-06-13T11:37:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.745+0000 7f8a0dffb640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f89fc06be30 0x7f89fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.745+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a1408b000 con 0x7f8a04004800 2024-06-13T11:37:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.745+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f89fc06be30 0x7f89fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.746+0000 7f8a1cde7640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f89fc06be30 0x7f89fc06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a08032000 tx=0x7f8a08009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.750+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a140590b0 con 0x7f8a04004800 2024-06-13T11:37:22.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.938+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a1804ffb0 con 0x7f8a04004800 2024-06-13T11:37:22.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.939+0000 7f8a0dffb640 1 -- 172.21.15.43:0/1394426377 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f8a1405d3b0 con 0x7f8a04004800 2024-06-13T11:37:22.939 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:22.939 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f89fc06be30 msgr2=0x7f89fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f89fc06be30 0x7f89fc06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a08032000 tx=0x7f8a08009030 comp rx=0 tx=0).stop 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 msgr2=0x7f8a1814aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a1814aa00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a14007340 tx=0x7f8a14007800 comp rx=0 tx=0).stop 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 shutdown_connections 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f89fc06be30 0x7f89fc06e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a181578c0 0x7f8a18157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a180b0160 0x7f8a180b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 --2- 172.21.15.43:0/1394426377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a04004800 0x7f8a1814aa00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 >> 172.21.15.43:0/1394426377 conn(0x7f8a18067640 msgr2=0x7f8a180ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 shutdown_connections 2024-06-13T11:37:22.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:22.941+0000 7f8a1f84c640 1 -- 172.21.15.43:0/1394426377 wait complete. 2024-06-13T11:37:22.952 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-13T11:37:22.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:23.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.056+0000 7fbeacd63640 1 Processor -- start 2024-06-13T11:37:23.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.056+0000 7fbeacd63640 1 -- start start 2024-06-13T11:37:23.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.057+0000 7fbeacd63640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 0x7fbea80ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.057+0000 7fbeacd63640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbea80ae9c0 0x7fbea80d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.057+0000 7fbeacd63640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea80aa5d0 con 0x7fbea80d2fd0 2024-06-13T11:37:23.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.057+0000 7fbeacd63640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbea8155800 con 0x7fbea80ae9c0 2024-06-13T11:37:23.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.057+0000 7fbeacd63640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbea80ace10 con 0x7fbea8155420 2024-06-13T11:37:23.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 0x7fbea80ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea5d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbea80ae9c0 0x7fbea80d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 0x7fbea80ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47462/0 (socket says 172.21.15.43:47462) 2024-06-13T11:37:23.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 -- 172.21.15.43:0/3573919103 learned_addr learned my addr 172.21.15.43:0/3573919103 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 -- 172.21.15.43:0/3573919103 >> v2:172.21.15.53:3300/0 conn(0x7fbea80ae9c0 msgr2=0x7fbea80d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 --2- 172.21.15.43:0/3573919103 >> v2:172.21.15.53:3300/0 conn(0x7fbea80ae9c0 0x7fbea80d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 -- 172.21.15.43:0/3573919103 >> v1:172.21.15.53:6789/0 conn(0x7fbea80d2fd0 legacy=0x7fbea8161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.058+0000 7fbea659c640 1 -- 172.21.15.43:0/3573919103 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea80aa870 con 0x7fbea8155420 2024-06-13T11:37:23.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.059+0000 7fbea659c640 1 --2- 172.21.15.43:0/3573919103 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 0x7fbea80ae480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009870 tx=0x7fbea002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a6bf15f9fb9ab92 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.059+0000 7fbea559a640 1 -- 172.21.15.43:0/3573919103 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0037070 con 0x7fbea8155420 2024-06-13T11:37:23.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.059+0000 7fbea559a640 1 -- 172.21.15.43:0/3573919103 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea0032440 con 0x7fbea8155420 2024-06-13T11:37:23.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.059+0000 7fbea559a640 1 -- 172.21.15.43:0/3573919103 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0032810 con 0x7fbea8155420 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.059+0000 7fbeacd63640 1 -- 172.21.15.43:0/3573919103 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 msgr2=0x7fbea80ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.059+0000 7fbeacd63640 1 --2- 172.21.15.43:0/3573919103 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 0x7fbea80ae480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009870 tx=0x7fbea002a270 comp rx=0 tx=0).stop 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.060+0000 7fbeacd63640 1 -- 172.21.15.43:0/3573919103 shutdown_connections 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.060+0000 7fbeacd63640 1 --2- 172.21.15.43:0/3573919103 >> v2:172.21.15.53:3300/0 conn(0x7fbea80ae9c0 0x7fbea80d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.060+0000 7fbeacd63640 1 --2- 172.21.15.43:0/3573919103 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea8155420 0x7fbea80ae480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.060+0000 7fbeacd63640 1 -- 172.21.15.43:0/3573919103 >> 172.21.15.43:0/3573919103 conn(0x7fbea8067640 msgr2=0x7fbea80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.060+0000 7fbeacd63640 1 -- 172.21.15.43:0/3573919103 shutdown_connections 2024-06-13T11:37:23.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.060+0000 7fbeacd63640 1 -- 172.21.15.43:0/3573919103 wait complete. 2024-06-13T11:37:23.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.061+0000 7fbeacd63640 1 Processor -- start 2024-06-13T11:37:23.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.061+0000 7fbeacd63640 1 -- start start 2024-06-13T11:37:23.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbeacd63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea80ae9c0 0x7fbea8137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbeacd63640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea80d2fd0 0x7fbea81559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbeacd63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 0x7fbea8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbeacd63640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbea80ab110 con 0x7fbea8155420 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbeacd63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbea80aae30 con 0x7fbea80ae9c0 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbeacd63640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbea80ab630 con 0x7fbea80d2fd0 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 0x7fbea8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea80ae9c0 0x7fbea8137960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 0x7fbea8155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47426/0 (socket says 172.21.15.43:47426) 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea5d9b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea80d2fd0 0x7fbea81559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 -- 172.21.15.43:0/20703033 learned_addr learned my addr 172.21.15.43:0/20703033 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 -- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea80d2fd0 msgr2=0x7fbea81559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea80d2fd0 0x7fbea81559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 -- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea80ae9c0 msgr2=0x7fbea8137960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea80ae9c0 0x7fbea8137960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 -- 172.21.15.43:0/20703033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea81e99d0 con 0x7fbea8155420 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea659c640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea80ae9c0 0x7fbea8137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.062+0000 7fbea6d9d640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 0x7fbea8155f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800c7a0 tx=0x7fbe9800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.063+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98003b70 con 0x7fbea8155420 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.063+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe98003d30 con 0x7fbea8155420 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.063+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea81e9cb0 con 0x7fbea8155420 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.063+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800aa90 con 0x7fbea8155420 2024-06-13T11:37:23.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.063+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea81ea270 con 0x7fbea8155420 2024-06-13T11:37:23.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.064+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea804ffb0 con 0x7fbea8155420 2024-06-13T11:37:23.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.064+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe9800ac30 con 0x7fbea8155420 2024-06-13T11:37:23.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.065+0000 7fbe9effd640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe8806be30 0x7fbe8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.065+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe9808afb0 con 0x7fbea8155420 2024-06-13T11:37:23.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.065+0000 7fbea659c640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe8806be30 0x7fbe8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.066+0000 7fbea659c640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe8806be30 0x7fbe8806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbea0034000 tx=0x7fbea002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.069+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbe98058fd0 con 0x7fbea8155420 2024-06-13T11:37:23.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.253+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbea80ab920 con 0x7fbea8155420 2024-06-13T11:37:23.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.255+0000 7fbe9effd640 1 -- 172.21.15.43:0/20703033 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fbe9805d2d0 con 0x7fbea8155420 2024-06-13T11:37:23.254 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:23.254 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:23.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe8806be30 msgr2=0x7fbe8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe8806be30 0x7fbe8806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbea0034000 tx=0x7fbea002e000 comp rx=0 tx=0).stop 2024-06-13T11:37:23.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 msgr2=0x7fbea8155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 0x7fbea8155f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800c7a0 tx=0x7fbe9800cc60 comp rx=0 tx=0).stop 2024-06-13T11:37:23.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 shutdown_connections 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe8806be30 0x7fbe8806e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea8155420 0x7fbea8155f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea80d2fd0 0x7fbea81559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 --2- 172.21.15.43:0/20703033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea80ae9c0 0x7fbea8137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 >> 172.21.15.43:0/20703033 conn(0x7fbea8067640 msgr2=0x7fbea815e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 shutdown_connections 2024-06-13T11:37:23.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.257+0000 7fbeacd63640 1 -- 172.21.15.43:0/20703033 wait complete. 2024-06-13T11:37:23.267 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-13T11:37:23.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-13T11:37:23.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-13T11:37:23.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-13T11:37:23.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-13T11:37:23.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-13T11:37:23.270 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-13T11:37:23.270 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-13T11:37:23.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.448+0000 7fd8d8f77640 1 Processor -- start 2024-06-13T11:37:23.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.449+0000 7f743880e640 1 Processor -- start 2024-06-13T11:37:23.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.449+0000 7f743880e640 1 -- start start 2024-06-13T11:37:23.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.449+0000 7fd8d8f77640 1 -- start start 2024-06-13T11:37:23.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.450+0000 7fd8d8f77640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd8d40cdf80 0x7fd8d4072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.450+0000 7fd8d8f77640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d4071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.450+0000 7fd8d8f77640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d4073170 con 0x7fd8d4072850 2024-06-13T11:37:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.450+0000 7fd8d8f77640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d4070810 con 0x7fd8d40cdf80 2024-06-13T11:37:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.450+0000 7fd8d8f77640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d4070a60 con 0x7fd8d4164030 2024-06-13T11:37:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f7c756ad640 1 Processor -- start 2024-06-13T11:37:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7fd8d1d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd8d40cdf80 0x7fd8d4072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7fd8d2d9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d4071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7fd8d2d9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d4071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47472/0 (socket says 172.21.15.43:47472) 2024-06-13T11:37:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7fd8d2d9d640 1 -- 172.21.15.43:0/1085369954 learned_addr learned my addr 172.21.15.43:0/1085369954 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.450+0000 7f446f4fc640 1 Processor -- start 2024-06-13T11:37:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f446f4fc640 1 -- start start 2024-06-13T11:37:23.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f743880e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f743415a420 0x7f743406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f743880e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f74340cc940 0x7f74340ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f743259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f743415a420 0x7f743406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f743259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f743415a420 0x7f743406ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43042/0 (socket says 172.21.15.43:43042) 2024-06-13T11:37:23.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f7432d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f74340cc940 0x7f74340ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f7432d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f74340cc940 0x7f74340ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47442/0 (socket says 172.21.15.43:47442) 2024-06-13T11:37:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f743259c640 1 -- 172.21.15.43:0/1452328345 learned_addr learned my addr 172.21.15.43:0/1452328345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743415e150 con 0x7f74340cbda0 2024-06-13T11:37:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f74340cc740 con 0x7f74340cc940 2024-06-13T11:37:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f743406e6c0 con 0x7f743415a420 2024-06-13T11:37:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7fd8d2d9d640 1 -- 172.21.15.43:0/1085369954 >> v2:172.21.15.43:3300/0 conn(0x7fd8d40cdf80 msgr2=0x7fd8d4072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446f4fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f446003b560 0x7f44600508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446f4fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4460050de0 0x7f4460038d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446f4fc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44600547d0 con 0x7f44600dfd30 2024-06-13T11:37:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446f4fc640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4460054ab0 con 0x7f4460050de0 2024-06-13T11:37:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446f4fc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4460054d90 con 0x7f446003b560 2024-06-13T11:37:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.451+0000 7f7c756ad640 1 -- start start 2024-06-13T11:37:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7c756ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c680e76a0 0x7f7c680513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7c756ad640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c680575a0 0x7f7c68052c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446ca97640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f446003b560 0x7f44600508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446ca97640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f446003b560 0x7f44600508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43052/0 (socket says 172.21.15.43:43052) 2024-06-13T11:37:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f446ca97640 1 -- 172.21.15.43:0/3319310621 learned_addr learned my addr 172.21.15.43:0/3319310621 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7c6f7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c680575a0 0x7f7c68052c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f446da99640 1 --2- 172.21.15.43:0/3319310621 >> v2:172.21.15.43:3300/0 conn(0x7f4460050de0 0x7f4460038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f446ca97640 1 -- 172.21.15.43:0/3319310621 >> v2:172.21.15.43:3300/0 conn(0x7f4460050de0 msgr2=0x7f4460038d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f446ca97640 1 --2- 172.21.15.43:0/3319310621 >> v2:172.21.15.43:3300/0 conn(0x7f4460050de0 0x7f4460038d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f446ca97640 1 -- 172.21.15.43:0/3319310621 >> v1:172.21.15.53:6789/0 conn(0x7f44600dfd30 legacy=0x7f4460053ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T11:37:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f446ca97640 1 -- 172.21.15.43:0/3319310621 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4460055070 con 0x7f446003b560 2024-06-13T11:37:23.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7432d9d640 1 -- 172.21.15.43:0/1452328345 >> v2:172.21.15.53:3300/0 conn(0x7f743415a420 msgr2=0x7f743406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7fd8d2d9d640 1 --2- 172.21.15.43:0/1085369954 >> v2:172.21.15.43:3300/0 conn(0x7fd8d40cdf80 0x7fd8d4072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7fd8d2d9d640 1 -- 172.21.15.43:0/1085369954 >> v1:172.21.15.43:6789/0 conn(0x7fd8d4072850 legacy=0x7fd8d40ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7432d9d640 1 --2- 172.21.15.43:0/1452328345 >> v2:172.21.15.53:3300/0 conn(0x7f743415a420 0x7f743406ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7fd8d2d9d640 1 -- 172.21.15.43:0/1085369954 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d4070d40 con 0x7fd8d4164030 2024-06-13T11:37:23.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7432d9d640 1 -- 172.21.15.43:0/1452328345 >> v1:172.21.15.43:6789/0 conn(0x7f74340cbda0 legacy=0x7f743406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.452+0000 7f7432d9d640 1 -- 172.21.15.43:0/1452328345 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74340cd2a0 con 0x7f74340cc940 2024-06-13T11:37:23.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7fd8d1d9b640 1 --2- 172.21.15.43:0/1085369954 >> v2:172.21.15.43:3300/0 conn(0x7fd8d40cdf80 0x7fd8d4072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f8cbe3c1640 1 Processor -- start 2024-06-13T11:37:23.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f38a6aed640 1 Processor -- start 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f7c6f7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c680575a0 0x7f7c68052c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47482/0 (socket says 172.21.15.43:47482) 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f7c74eac640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c68049d40 0x7f7c68036600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:49762/0 (socket says 172.21.15.43:49762) 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f7c6f7fe640 1 -- 172.21.15.43:0/1664083646 learned_addr learned my addr 172.21.15.43:0/1664083646 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.453+0000 7f7c6ffff640 1 --2- 172.21.15.43:0/1664083646 >> v2:172.21.15.53:3300/0 conn(0x7f7c680e76a0 0x7f7c680513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c68051900 con 0x7f7c68049d40 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7c68051ba0 con 0x7f7c680e76a0 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7c68051e80 con 0x7f7c680575a0 2024-06-13T11:37:23.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f38a6aed640 1 -- start start 2024-06-13T11:37:23.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174185975 0 0) 0x7f7c68051900 con 0x7f7c68049d40 2024-06-13T11:37:23.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c60003520 con 0x7f7c68049d40 2024-06-13T11:37:23.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7fd8d2d9d640 1 --2- 172.21.15.43:0/1085369954 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d4071b00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009e50 tx=0x7fd8cc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271b79905d267f09 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f8cbe3c1640 1 -- start start 2024-06-13T11:37:23.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7432d9d640 1 --2- 172.21.15.43:0/1452328345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cc940 0x7f74340ccd60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f743406df80 tx=0x7f742c02f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1952d912b7428da server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7fd8d159a640 1 -- 172.21.15.43:0/1085369954 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc036070 con 0x7fd8d4164030 2024-06-13T11:37:23.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f8dd345d640 1 Processor -- start 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 <== mon.1 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 177377531 0 0) 0x7f7c60003520 con 0x7f7c68049d40 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c680575a0 msgr2=0x7f7c68052c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c680575a0 0x7f7c68052c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 >> v2:172.21.15.53:3300/0 conn(0x7f7c680e76a0 msgr2=0x7f7c680513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 --2- 172.21.15.43:0/1664083646 >> v2:172.21.15.53:3300/0 conn(0x7f7c680e76a0 0x7f7c680513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c68052160 con 0x7f7c68049d40 2024-06-13T11:37:23.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 <== mon.1 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f7c70074590 con 0x7f7c68049d40 2024-06-13T11:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f743159a640 1 -- 172.21.15.43:0/1452328345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c03c070 con 0x7f74340cc940 2024-06-13T11:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f743159a640 1 -- 172.21.15.43:0/1452328345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c02fb70 con 0x7f74340cc940 2024-06-13T11:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7fd8d159a640 1 -- 172.21.15.43:0/1085369954 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc031600 con 0x7fd8d4164030 2024-06-13T11:37:23.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f743159a640 1 -- 172.21.15.43:0/1452328345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c037440 con 0x7f74340cc940 2024-06-13T11:37:23.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7fd8d159a640 1 -- 172.21.15.43:0/1085369954 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc031a10 con 0x7fd8d4164030 2024-06-13T11:37:23.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f8dd345d640 1 -- start start 2024-06-13T11:37:23.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f446ca97640 1 --2- 172.21.15.43:0/3319310621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446003b560 0x7f44600508a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44600e38a0 tx=0x7f445802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5c60dc24469aff server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f445ffff640 1 -- 172.21.15.43:0/3319310621 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458037070 con 0x7f446003b560 2024-06-13T11:37:23.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f445ffff640 1 -- 172.21.15.43:0/3319310621 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458032440 con 0x7f446003b560 2024-06-13T11:37:23.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f445ffff640 1 -- 172.21.15.43:0/3319310621 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458032810 con 0x7f446003b560 2024-06-13T11:37:23.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f8cbe3c1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb806e570 0x7f8cb815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f8cbe3c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8cb8067220 0x7f8cb80b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f8cbe3c1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb8161200 con 0x7f8cb8067680 2024-06-13T11:37:23.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f8cbe3c1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb80b13d0 con 0x7f8cb8067220 2024-06-13T11:37:23.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f8cbe3c1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb80b16b0 con 0x7f8cb806e570 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 >> v1:172.21.15.53:6789/0 conn(0x7f7c68049d40 legacy=0x7f7c68036600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.454+0000 7f7c6effd640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c600039b0 0x7f7c60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6effd640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c60004350 0x7f7c60004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6effd640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c60004e40 0x7f7c600052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68051ba0 con 0x7f7c60004e40 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68051e80 con 0x7f7c60004350 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6000bde0 con 0x7f7c600039b0 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c74eac640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c60004e40 0x7f7c600052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6ffff640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c600039b0 0x7f7c60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c74eac640 1 -- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c600039b0 msgr2=0x7f7c60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c74eac640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c600039b0 0x7f7c60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c74eac640 1 -- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c60004350 msgr2=0x7f7c60004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c6f7fe640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c60004350 0x7f7c60004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c74eac640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c60004350 0x7f7c60004820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1085369954 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 msgr2=0x7fd8d4071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7fd8d8f77640 1 --2- 172.21.15.43:0/1085369954 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d4071b00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009e50 tx=0x7fd8cc02a660 comp rx=0 tx=0).stop 2024-06-13T11:37:23.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.455+0000 7f7c74eac640 1 -- 172.21.15.43:0/1664083646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c60003520 con 0x7f7c60004e40 2024-06-13T11:37:23.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f446f4fc640 1 -- 172.21.15.43:0/3319310621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446003b560 msgr2=0x7f44600508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f446f4fc640 1 --2- 172.21.15.43:0/3319310621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446003b560 0x7f44600508a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44600e38a0 tx=0x7f445802a230 comp rx=0 tx=0).stop 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a6aed640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3898006a30 0x7f3898006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a6aed640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898053720 con 0x7f3898005ee0 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a6aed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898053a00 con 0x7f38980ead00 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a6aed640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3898054330 con 0x7f3898006a30 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a52ea640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3898005ee0 0x7f3898006320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52940/0 (socket says 172.21.15.43:52940) 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a52ea640 1 -- 172.21.15.43:0/440720846 learned_addr learned my addr 172.21.15.43:0/440720846 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a62ec640 1 --2- 172.21.15.43:0/440720846 >> v2:172.21.15.43:3300/0 conn(0x7f3898006a30 0x7f3898006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f446f4fc640 1 -- 172.21.15.43:0/3319310621 shutdown_connections 2024-06-13T11:37:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f446f4fc640 1 --2- 172.21.15.43:0/3319310621 >> v2:172.21.15.43:3300/0 conn(0x7f4460050de0 0x7f4460038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f446f4fc640 1 --2- 172.21.15.43:0/3319310621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446003b560 0x7f44600508a0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44600e38a0 tx=0x7f445802a230 comp rx=0 tx=0).stop 2024-06-13T11:37:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f446f4fc640 1 -- 172.21.15.43:0/3319310621 >> 172.21.15.43:0/3319310621 conn(0x7f4460055bd0 msgr2=0x7f4460055fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8cbc95e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8cb8067680 0x7f8cb8071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:49774/0 (socket says 172.21.15.43:49774) 2024-06-13T11:37:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8cbc95e640 1 -- 172.21.15.43:0/915628189 learned_addr learned my addr 172.21.15.43:0/915628189 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:23.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cc940 msgr2=0x7f74340ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f743880e640 1 --2- 172.21.15.43:0/1452328345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cc940 0x7f74340ccd60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f743406df80 tx=0x7f742c02f050 comp rx=0 tx=0).stop 2024-06-13T11:37:23.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8cb7fff640 1 --2- 172.21.15.43:0/915628189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb806e570 0x7f8cb815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8dd345d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0cc030 0x7f8dcc15a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8dd345d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 0x7f8dcc0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8dd345d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8dcc0ccbf0 0x7f8dcc0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f8cb77fe640 1 --2- 172.21.15.43:0/915628189 >> v2:172.21.15.53:3300/0 conn(0x7f8cb8067220 0x7f8cb80b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a4ae9640 1 -- 172.21.15.43:0/440720846 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367519744 0 0) 0x7f3898053720 con 0x7f3898005ee0 2024-06-13T11:37:23.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f38a4ae9640 1 -- 172.21.15.43:0/440720846 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f388c003520 con 0x7f3898005ee0 2024-06-13T11:37:23.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.456+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 shutdown_connections 2024-06-13T11:37:23.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f743880e640 1 --2- 172.21.15.43:0/1452328345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cc940 0x7f74340ccd60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f743880e640 1 --2- 172.21.15.43:0/1452328345 >> v2:172.21.15.53:3300/0 conn(0x7f743415a420 0x7f743406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f38a62ec640 1 -- 172.21.15.43:0/440720846 >> v1:172.21.15.53:6789/0 conn(0x7f38980ead00 legacy=0x7f389804fa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T11:37:23.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 >> 172.21.15.43:0/1452328345 conn(0x7f7434067820 msgr2=0x7f74340d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8dcc0ccbf0 0x7f8dcc0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8dcc0ccbf0 0x7f8dcc0b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47476/0 (socket says 172.21.15.43:47476) 2024-06-13T11:37:23.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd09f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 0x7f8dcc0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f38a62ec640 1 -- 172.21.15.43:0/440720846 >> v1:172.21.15.43:6789/0 conn(0x7f3898005ee0 legacy=0x7f3898006320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd09f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 0x7f8dcc0b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43084/0 (socket says 172.21.15.43:43084) 2024-06-13T11:37:23.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 -- 172.21.15.43:0/4083907303 learned_addr learned my addr 172.21.15.43:0/4083907303 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f446f4fc640 1 -- 172.21.15.43:0/3319310621 shutdown_connections 2024-06-13T11:37:23.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8cb7fff640 1 -- 172.21.15.43:0/915628189 >> v2:172.21.15.53:3300/0 conn(0x7f8cb8067220 msgr2=0x7f8cb80b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8cb7fff640 1 --2- 172.21.15.43:0/915628189 >> v2:172.21.15.53:3300/0 conn(0x7f8cb8067220 0x7f8cb80b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8dcc15a950 con 0x7f8dcc0ccbf0 2024-06-13T11:37:23.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8dcc161430 con 0x7f8dcc06eed0 2024-06-13T11:37:23.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8dcc0cd3d0 con 0x7f8dcc0cc030 2024-06-13T11:37:23.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8cb7fff640 1 -- 172.21.15.43:0/915628189 >> v1:172.21.15.53:6789/0 conn(0x7f8cb8067680 legacy=0x7f8cb8071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8cb7fff640 1 -- 172.21.15.43:0/915628189 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb80b1990 con 0x7f8cb806e570 2024-06-13T11:37:23.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f38a62ec640 1 -- 172.21.15.43:0/440720846 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898053ce0 con 0x7f3898006a30 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f7c74eac640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c60004e40 0x7f7c600052c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c70051060 tx=0x7f7c60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cdd6edca7c46eb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7004ffb0 con 0x7f7c60004e40 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c7008f070 con 0x7f7c60004e40 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f7c6effd640 1 -- 172.21.15.43:0/1664083646 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70070d90 con 0x7f7c60004e40 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 -- 172.21.15.43:0/4083907303 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0cc030 msgr2=0x7f8dcc15a410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 --2- 172.21.15.43:0/4083907303 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0cc030 0x7f8dcc15a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 -- 172.21.15.43:0/4083907303 >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 msgr2=0x7f8dcc0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 --2- 172.21.15.43:0/4083907303 >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 0x7f8dcc0b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd19fa640 1 -- 172.21.15.43:0/4083907303 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc0cd6b0 con 0x7f8dcc0ccbf0 2024-06-13T11:37:23.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f8dd09f8640 1 --2- 172.21.15.43:0/4083907303 >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 0x7f8dcc0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 shutdown_connections 2024-06-13T11:37:23.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f743880e640 1 -- 172.21.15.43:0/1452328345 wait complete. 2024-06-13T11:37:23.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1085369954 shutdown_connections 2024-06-13T11:37:23.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7fd8d8f77640 1 --2- 172.21.15.43:0/1085369954 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d4071b00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7fd8d8f77640 1 --2- 172.21.15.43:0/1085369954 >> v2:172.21.15.43:3300/0 conn(0x7fd8d40cdf80 0x7fd8d4072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1085369954 >> 172.21.15.43:0/1085369954 conn(0x7fd8d40b14b0 msgr2=0x7fd8d40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f38a62ec640 1 --2- 172.21.15.43:0/440720846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3898006a30 0x7f3898006ea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f38a006a140 tx=0x7f38a00a5060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8839ed9309610c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.457+0000 7f446f4fc640 1 -- 172.21.15.43:0/3319310621 wait complete. 2024-06-13T11:37:23.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1085369954 shutdown_connections 2024-06-13T11:37:23.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c60004e40 msgr2=0x7f7c600052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f7c756ad640 1 --2- 172.21.15.43:0/1664083646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c60004e40 0x7f7c600052c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c70051060 tx=0x7f7c60005830 comp rx=0 tx=0).stop 2024-06-13T11:37:23.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f38a4ae9640 1 -- 172.21.15.43:0/440720846 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00b2070 con 0x7f3898006a30 2024-06-13T11:37:23.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f7c74eac640 1 -- 172.21.15.43:0/1664083646 reap_dead start 2024-06-13T11:37:23.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f38a4ae9640 1 -- 172.21.15.43:0/440720846 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a00a5e30 con 0x7f3898006a30 2024-06-13T11:37:23.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 shutdown_connections 2024-06-13T11:37:23.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 >> 172.21.15.43:0/1664083646 conn(0x7f7c68020040 msgr2=0x7f7c68056d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f8dd19fa640 1 --2- 172.21.15.43:0/4083907303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0ccbf0 0x7f8dcc0b0da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc067ce0 tx=0x7f8dc402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3020bed2ab1d9503 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7f8cb7fff640 1 --2- 172.21.15.43:0/915628189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb806e570 0x7f8cb815a5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80b1cd0 tx=0x7f8cac02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b59ea99eb0d0969 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f8dc3fff640 1 -- 172.21.15.43:0/4083907303 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4036070 con 0x7f8dcc0ccbf0 2024-06-13T11:37:23.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f446f4fc640 1 Processor -- start 2024-06-13T11:37:23.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f8cb6ffd640 1 -- 172.21.15.43:0/915628189 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac037070 con 0x7f8cb806e570 2024-06-13T11:37:23.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f8cb6ffd640 1 -- 172.21.15.43:0/915628189 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac032440 con 0x7f8cb806e570 2024-06-13T11:37:23.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f8cb6ffd640 1 -- 172.21.15.43:0/915628189 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac032810 con 0x7f8cb806e570 2024-06-13T11:37:23.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f8dc3fff640 1 -- 172.21.15.43:0/4083907303 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc4031600 con 0x7f8dcc0ccbf0 2024-06-13T11:37:23.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f8dc3fff640 1 -- 172.21.15.43:0/4083907303 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40319d0 con 0x7f8dcc0ccbf0 2024-06-13T11:37:23.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f446f4fc640 1 -- start start 2024-06-13T11:37:23.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.458+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1085369954 wait complete. 2024-06-13T11:37:23.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f9bc2053640 1 Processor -- start 2024-06-13T11:37:23.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f9bc2053640 1 -- start start 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 shutdown_connections 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/915628189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb806e570 msgr2=0x7f8cb815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 --2- 172.21.15.43:0/915628189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb806e570 0x7f8cb815a5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80b1cd0 tx=0x7f8cac02a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/915628189 shutdown_connections 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 --2- 172.21.15.43:0/915628189 >> v2:172.21.15.53:3300/0 conn(0x7f8cb8067220 0x7f8cb80b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 --2- 172.21.15.43:0/915628189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb806e570 0x7f8cb815a5d0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80b1cd0 tx=0x7f8cac02a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/915628189 >> 172.21.15.43:0/915628189 conn(0x7f8cb80b21f0 msgr2=0x7f8cb80b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0ccbf0 msgr2=0x7f8dcc0b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 --2- 172.21.15.43:0/4083907303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0ccbf0 0x7f8dcc0b0da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc067ce0 tx=0x7f8dc402a750 comp rx=0 tx=0).stop 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 shutdown_connections 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 --2- 172.21.15.43:0/4083907303 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0ccbf0 0x7f8dcc0b0da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 --2- 172.21.15.43:0/4083907303 >> v2:172.21.15.53:3300/0 conn(0x7f8dcc06eed0 0x7f8dcc0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 --2- 172.21.15.43:0/4083907303 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0cc030 0x7f8dcc15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 >> 172.21.15.43:0/4083907303 conn(0x7f8dcc067640 msgr2=0x7f8dcc0b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f38a6aed640 1 -- 172.21.15.43:0/440720846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3898006a30 msgr2=0x7f3898006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f38a6aed640 1 --2- 172.21.15.43:0/440720846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3898006a30 0x7f3898006ea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f38a006a140 tx=0x7f38a00a5060 comp rx=0 tx=0).stop 2024-06-13T11:37:23.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f38a6aed640 1 -- 172.21.15.43:0/440720846 shutdown_connections 2024-06-13T11:37:23.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f38a6aed640 1 --2- 172.21.15.43:0/440720846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3898006a30 0x7f3898006ea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f38a6aed640 1 -- 172.21.15.43:0/440720846 >> 172.21.15.43:0/440720846 conn(0x7f3898009fb0 msgr2=0x7f389800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f743880e640 1 Processor -- start 2024-06-13T11:37:23.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f743880e640 1 -- start start 2024-06-13T11:37:23.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 shutdown_connections 2024-06-13T11:37:23.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f446f4fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4460050de0 0x7f446004f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7fd8d8f77640 1 Processor -- start 2024-06-13T11:37:23.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f446f4fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44600dfd30 0x7f44600d7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/915628189 shutdown_connections 2024-06-13T11:37:23.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7fd8d8f77640 1 -- start start 2024-06-13T11:37:23.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f446f4fc640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4460187980 0x7f44600d8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f446f4fc640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4460055870 con 0x7f44600dfd30 2024-06-13T11:37:23.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bc2053640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bbc0ce5a0 0x7f9bbc0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f446f4fc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f44600e0110 con 0x7f4460050de0 2024-06-13T11:37:23.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f446f4fc640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4460187f40 con 0x7f4460187980 2024-06-13T11:37:23.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f38a6aed640 1 -- 172.21.15.43:0/440720846 shutdown_connections 2024-06-13T11:37:23.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bc2053640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9bbc0b1880 0x7f9bbc06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f446ca97640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44600dfd30 0x7f44600d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bbb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bbc0ce5a0 0x7f9bbc0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bbb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bbc0ce5a0 0x7f9bbc0b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43092/0 (socket says 172.21.15.43:43092) 2024-06-13T11:37:23.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f446ca97640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44600dfd30 0x7f44600d7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47478/0 (socket says 172.21.15.43:47478) 2024-06-13T11:37:23.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f446ca97640 1 -- 172.21.15.43:0/2579682448 learned_addr learned my addr 172.21.15.43:0/2579682448 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bbb7fe640 1 -- 172.21.15.43:0/2281483205 learned_addr learned my addr 172.21.15.43:0/2281483205 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f446da99640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4460187980 0x7f44600d8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bbaffd640 1 --2- 172.21.15.43:0/2281483205 >> v2:172.21.15.43:3300/0 conn(0x7f9bbc0b1880 0x7f9bbc06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.459+0000 7f7c756ad640 1 -- 172.21.15.43:0/1664083646 wait complete. 2024-06-13T11:37:23.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f7c756ad640 1 Processor -- start 2024-06-13T11:37:23.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bbc0b05f0 con 0x7f9bbc06e500 2024-06-13T11:37:23.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9bbc06e910 con 0x7f9bbc0b1880 2024-06-13T11:37:23.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9bbc0b0860 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f743880e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cbda0 0x7f74341404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/915628189 wait complete. 2024-06-13T11:37:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.461+0000 7f743880e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74340cc940 0x7f74341efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cbda0 0x7f74341404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cbda0 0x7f74341404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47490/0 (socket says 172.21.15.43:47490) 2024-06-13T11:37:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743880e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f743415a420 0x7f743414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f446ca97640 1 -- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4460187980 msgr2=0x7f44600d8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f446ca97640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4460187980 0x7f44600d8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f446ca97640 1 -- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4460050de0 msgr2=0x7f446004f7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-13T11:37:23.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f446ca97640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4460050de0 0x7f446004f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f446ca97640 1 -- 172.21.15.43:0/2579682448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4460188220 con 0x7f44600dfd30 2024-06-13T11:37:23.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7fd8d8f77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d4072850 0x7fd8d41f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743259c640 1 -- 172.21.15.43:0/1123289518 learned_addr learned my addr 172.21.15.43:0/1123289518 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f9bbaffd640 1 -- 172.21.15.43:0/2281483205 >> v2:172.21.15.53:3300/0 conn(0x7f9bbc0ce5a0 msgr2=0x7f9bbc0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f9bbaffd640 1 --2- 172.21.15.43:0/2281483205 >> v2:172.21.15.53:3300/0 conn(0x7f9bbc0ce5a0 0x7f9bbc0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f9bbaffd640 1 -- 172.21.15.43:0/2281483205 >> v1:172.21.15.43:6789/0 conn(0x7f9bbc06e500 legacy=0x7f9bbc15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f9bbaffd640 1 -- 172.21.15.43:0/2281483205 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc0b0b40 con 0x7f9bbc0b1880 2024-06-13T11:37:23.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f743406d9f0 con 0x7f74340cbda0 2024-06-13T11:37:23.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f743406d710 con 0x7f74340cc940 2024-06-13T11:37:23.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f38a6aed640 1 -- 172.21.15.43:0/440720846 wait complete. 2024-06-13T11:37:23.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f743406dcd0 con 0x7f743415a420 2024-06-13T11:37:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.460+0000 7f8dd345d640 1 -- 172.21.15.43:0/4083907303 wait complete. 2024-06-13T11:37:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7fd8d8f77640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d40cdf80 0x7fd8d4142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7fd8d8f77640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d41631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f7431d9b640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74340cc940 0x7f74341efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7fd8d8f77640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40715e0 con 0x7fd8d40cdf80 2024-06-13T11:37:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7fd8d8f77640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4071300 con 0x7fd8d4072850 2024-06-13T11:37:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7fd8d8f77640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d4148f70 con 0x7fd8d4164030 2024-06-13T11:37:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f7c756ad640 1 -- start start 2024-06-13T11:37:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f8dd345d640 1 Processor -- start 2024-06-13T11:37:23.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f446ca97640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44600dfd30 0x7f44600d7830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f445802a7a0 tx=0x7f44580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458041020 con 0x7f44600dfd30 2024-06-13T11:37:23.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7432d9d640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f743415a420 0x7f743414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c756ad640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c60004e40 0x7f7c6804d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458030760 con 0x7f44600dfd30 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4460188500 con 0x7f44600dfd30 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f743259c640 1 -- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f743415a420 msgr2=0x7f743414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f743259c640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f743415a420 0x7f743414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f743259c640 1 -- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74340cc940 msgr2=0x7f74341efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f743259c640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74340cc940 0x7f74341efbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f743259c640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7434143e60 con 0x7f74340cbda0 2024-06-13T11:37:23.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c756ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c6804ef80 0x7f7c6804de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7432d9d640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f743415a420 0x7f743414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:23.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c60004e40 0x7f7c6804d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c60004e40 0x7f7c6804d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47546/0 (socket says 172.21.15.43:47546) 2024-06-13T11:37:23.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c6ffff640 1 -- 172.21.15.43:0/2493734861 learned_addr learned my addr 172.21.15.43:0/2493734861 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c6f7fe640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c6804ef80 0x7f7c6804de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f7c756ad640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68055b60 0x7f7c680e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44600d7d70 con 0x7f44600dfd30 2024-06-13T11:37:23.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f743259c640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cbda0 0x7f74341404e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f742400d960 tx=0x7f742400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c680e7a80 con 0x7f7c6804ef80 2024-06-13T11:37:23.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68052720 con 0x7f7c68055b60 2024-06-13T11:37:23.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7c68036d10 con 0x7f7c60004e40 2024-06-13T11:37:23.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d4072850 0x7fd8d41f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d4072850 0x7fd8d41f98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43126/0 (socket says 172.21.15.43:43126) 2024-06-13T11:37:23.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c74eac640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68055b60 0x7f7c680e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d40cdf80 0x7fd8d4142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d259c640 1 -- 172.21.15.43:0/1129925209 learned_addr learned my addr 172.21.15.43:0/1129925209 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d2d9d640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d41631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f8dd345d640 1 -- start start 2024-06-13T11:37:23.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.462+0000 7f8cbe3c1640 1 Processor -- start 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.463+0000 7f8cbe3c1640 1 -- start start 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbe3c1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb8067220 0x7f8cb814aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbe3c1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb8067680 0x7f8cb815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbe3c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb815e950 0x7f8cb815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbe3c1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb80cde30 con 0x7f8cb8067220 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbe3c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb80cdcb0 con 0x7f8cb815e950 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbe3c1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb80b0fa0 con 0x7f8cb8067680 2024-06-13T11:37:23.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f9bbaffd640 1 --2- 172.21.15.43:0/2281483205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc0b1880 0x7f9bbc06dfc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0cee90 tx=0x7f9bb002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5a601d114f502d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8dd345d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dcc06eed0 0x7f8dcc200590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8dd345d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0cc030 0x7f8dcc1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c74eac640 1 -- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c60004e40 msgr2=0x7f7c6804d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb8067680 0x7f8cb815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb8067680 0x7f8cb815b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47548/0 (socket says 172.21.15.43:47548) 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cb77fe640 1 -- 172.21.15.43:0/2537735703 learned_addr learned my addr 172.21.15.43:0/2537735703 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8cbc95e640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb815e950 0x7f8cb815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c74eac640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7c60004e40 0x7f7c6804d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c74eac640 1 -- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c6804ef80 msgr2=0x7f7c6804de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c74eac640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c6804ef80 0x7f7c6804de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f7c74eac640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6804e380 con 0x7f7c68055b60 2024-06-13T11:37:23.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f38a6aed640 1 Processor -- start 2024-06-13T11:37:23.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742400ab80 con 0x7f74340cbda0 2024-06-13T11:37:23.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7434140a20 con 0x7f74340cbda0 2024-06-13T11:37:23.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f8dd345d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0ccbf0 0x7f8dcc158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d259c640 1 -- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 msgr2=0x7fd8d41631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d259c640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd8d4164030 0x7fd8d41631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7fd8d259c640 1 -- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d40cdf80 msgr2=0x7fd8d4142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f38a6aed640 1 -- start start 2024-06-13T11:37:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f7c74eac640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68055b60 0x7f7c680e3480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c7006a140 tx=0x7f7c68052330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74341f3d50 con 0x7f74340cbda0 2024-06-13T11:37:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd345d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc0ce190 con 0x7f8dcc0cc030 2024-06-13T11:37:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd345d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc0cdc70 con 0x7f8dcc06eed0 2024-06-13T11:37:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd345d640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8dcc0ce310 con 0x7f8dcc0ccbf0 2024-06-13T11:37:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dcc06eed0 0x7f8dcc200590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd19fa640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0ccbf0 0x7f8dcc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dcc06eed0 0x7f8dcc200590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43152/0 (socket says 172.21.15.43:43152) 2024-06-13T11:37:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 -- 172.21.15.43:0/3016258471 learned_addr learned my addr 172.21.15.43:0/3016258471 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.464+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458037040 con 0x7f44600dfd30 2024-06-13T11:37:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8cb7fff640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb8067220 0x7f8cb814aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f7c6f7fe640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c6804ef80 0x7f7c6804de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7004ffb0 con 0x7f7c68055b60 2024-06-13T11:37:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c70074550 con 0x7f7c68055b60 2024-06-13T11:37:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7fd8d259c640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d40cdf80 0x7fd8d4142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c700722d0 con 0x7f7c68055b60 2024-06-13T11:37:23.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f44537fe640 1 -- 172.21.15.43:0/2579682448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4460188bc0 con 0x7f44600dfd30 2024-06-13T11:37:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7fd8d259c640 1 -- 172.21.15.43:0/1129925209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d41f8e50 con 0x7fd8d4072850 2024-06-13T11:37:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7fd8d1d9b640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d40cdf80 0x7fd8d4142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f9bba7fc640 1 -- 172.21.15.43:0/2281483205 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0037070 con 0x7f9bbc0b1880 2024-06-13T11:37:23.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 -- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0ccbf0 msgr2=0x7f8dcc158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f9bba7fc640 1 -- 172.21.15.43:0/2281483205 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb0032440 con 0x7f9bbc0b1880 2024-06-13T11:37:23.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7fd8d259c640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d4072850 0x7fd8d41f98f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800b3e0 tx=0x7fd8c800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8dcc0ccbf0 0x7f8dcc158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 -- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0cc030 msgr2=0x7f8dcc1580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8dcc0cc030 0x7f8dcc1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f9bba7fc640 1 -- 172.21.15.43:0/2281483205 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb002ae60 con 0x7f9bbc0b1880 2024-06-13T11:37:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6803aa10 con 0x7f7c68055b60 2024-06-13T11:37:23.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a6aed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898005ee0 0x7f38980e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.465+0000 7f8dd11f9640 1 -- 172.21.15.43:0/3016258471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc15b270 con 0x7f8dcc06eed0 2024-06-13T11:37:23.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6804e780 con 0x7f7c68055b60 2024-06-13T11:37:23.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8cbc95e640 1 -- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb8067680 msgr2=0x7f8cb815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8cbc95e640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8cb8067680 0x7f8cb815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8cbc95e640 1 -- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb8067220 msgr2=0x7f8cb814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8cbc95e640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb8067220 0x7f8cb814aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8cbc95e640 1 -- 172.21.15.43:0/2537735703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb814cb60 con 0x7f8cb815e950 2024-06-13T11:37:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8015020 con 0x7fd8d4072850 2024-06-13T11:37:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d4143860 con 0x7fd8d4072850 2024-06-13T11:37:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d41f90f0 con 0x7fd8d4072850 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a6aed640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980ead00 0x7f389804a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a6aed640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3898043680 0x7f3898044be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a6aed640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38980547c0 con 0x7f38980ead00 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a6aed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38980501a0 con 0x7f3898005ee0 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a6aed640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3898054940 con 0x7f3898043680 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898005ee0 0x7f38980e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898005ee0 0x7f38980e5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43162/0 (socket says 172.21.15.43:43162) 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 -- 172.21.15.43:0/1134384790 learned_addr learned my addr 172.21.15.43:0/1134384790 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a62ec640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3898043680 0x7f3898044be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a52ea640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980ead00 0x7f389804a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8dd11f9640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dcc06eed0 0x7f8dcc200590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00b480 tx=0x7f8dbc00b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f8cbc95e640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb815e950 0x7f8cb815b900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000caf0 tx=0x7f8cb000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 -- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3898043680 msgr2=0x7f3898044be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3898043680 0x7f3898044be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 -- 172.21.15.43:0/1134384790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980ead00 msgr2=0x7f389804a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7f38a5aeb640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980ead00 0x7f389804a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f38a5aeb640 1 -- 172.21.15.43:0/1134384790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898043b40 con 0x7f3898005ee0 2024-06-13T11:37:23.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc0b1880 msgr2=0x7f9bbc06dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc014070 con 0x7f8dcc06eed0 2024-06-13T11:37:23.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f9bc2053640 1 --2- 172.21.15.43:0/2281483205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc0b1880 0x7f9bbc06dfc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0cee90 tx=0x7f9bb002a110 comp rx=0 tx=0).stop 2024-06-13T11:37:23.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c8011830 con 0x7fd8d4072850 2024-06-13T11:37:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.466+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8015020 con 0x7fd8d4072850 2024-06-13T11:37:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c68005710 con 0x7f7c68055b60 2024-06-13T11:37:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8b8001030 con 0x7fd8d4072850 2024-06-13T11:37:23.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dcc14a130 con 0x7f8dcc06eed0 2024-06-13T11:37:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dcc158f20 con 0x7f8dcc06eed0 2024-06-13T11:37:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f38a5aeb640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898005ee0 0x7f38980e5960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f389c01c3f0 tx=0x7f389c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c026020 con 0x7f3898005ee0 2024-06-13T11:37:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c022640 con 0x7f3898005ee0 2024-06-13T11:37:23.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c022a10 con 0x7f3898005ee0 2024-06-13T11:37:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000abd0 con 0x7f8cb815e950 2024-06-13T11:37:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb000ad70 con 0x7f8cb815e950 2024-06-13T11:37:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.467+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0012640 con 0x7f8cb815e950 2024-06-13T11:37:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3898043e20 con 0x7f3898005ee0 2024-06-13T11:37:23.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38980443e0 con 0x7f3898005ee0 2024-06-13T11:37:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 shutdown_connections 2024-06-13T11:37:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f9bc2053640 1 --2- 172.21.15.43:0/2281483205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc0b1880 0x7f9bbc06dfc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f9bc2053640 1 --2- 172.21.15.43:0/2281483205 >> v2:172.21.15.53:3300/0 conn(0x7f9bbc0ce5a0 0x7f9bbc0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 >> 172.21.15.43:0/2281483205 conn(0x7f9bbc0673d0 msgr2=0x7f9bbc06b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc010870 con 0x7f8dcc06eed0 2024-06-13T11:37:23.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc01e060 con 0x7f8dcc06eed0 2024-06-13T11:37:23.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4458044020 con 0x7f44600dfd30 2024-06-13T11:37:23.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8dac001030 con 0x7f8dcc06eed0 2024-06-13T11:37:23.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/2537735703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb814ce40 con 0x7f8cb815e950 2024-06-13T11:37:23.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/2537735703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb8160460 con 0x7f8cb815e950 2024-06-13T11:37:23.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3888001030 con 0x7f3898005ee0 2024-06-13T11:37:23.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dbc017070 con 0x7f8dcc06eed0 2024-06-13T11:37:23.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f445dffb640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f444c06bf00 0x7f444c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f44580abde0 con 0x7f44600dfd30 2024-06-13T11:37:23.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f446d298640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f444c06bf00 0x7f444c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f445dffb640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] conn(0x7f444c075670 0x7f444c077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c70072470 con 0x7f7c68055b60 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6cff9640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7c5406bf00 0x7f7c5406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c70126b50 con 0x7f7c68055b60 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6ffff640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7c5406bf00 0x7f7c5406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6cff9640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] conn(0x7f7c54075680 0x7f7c54077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c54078190 con 0x7f7c54075680 2024-06-13T11:37:23.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c70126ec0 con 0x7f7c68055b60 2024-06-13T11:37:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 --> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f444c078180 con 0x7f444c075670 2024-06-13T11:37:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44580ac1d0 con 0x7f44600dfd30 2024-06-13T11:37:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 shutdown_connections 2024-06-13T11:37:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f8dc1ffb640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8db006be30 0x7f8db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742400ad20 con 0x7f74340cbda0 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424010670 con 0x7f74340cbda0 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.468+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7424010810 con 0x7f74340cbda0 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7f742affd640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f741406be60 0x7f741406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.469+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8c8018020 con 0x7fd8d4072850 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7fd8c2ffd640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd8b406c030 0x7fd8b406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7fd8d1d9b640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd8b406c030 0x7fd8b406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd8c8056e30 con 0x7fd8d4072850 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7fd8c2ffd640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] conn(0x7fd8b4076370 0x7fd8b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 --> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8b4078ee0 con 0x7fd8b4076370 2024-06-13T11:37:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f446da99640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] conn(0x7f444c075670 0x7f444c077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f742408b760 con 0x7f74340cbda0 2024-06-13T11:37:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7431d9b640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f741406be60 0x7f741406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f743880e640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] conn(0x7f7418001650 0x7f7418003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7418006bb0 con 0x7f7418001650 2024-06-13T11:37:23.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f7431d9b640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f741406be60 0x7f741406e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74341441a0 tx=0x7f741c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.470+0000 7f7c6f7fe640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] conn(0x7f7c54075680 0x7f7c54077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f7c6f7fe640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] conn(0x7f7c54075680 0x7f7c54077ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f7c6ffff640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7c5406bf00 0x7f7c5406e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c6804d0a0 tx=0x7f7c64009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cb00127e0 con 0x7f8cb815e950 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8dbc08b1c0 con 0x7f8dcc06eed0 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f8dc1ffb640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] conn(0x7f8db0075520 0x7f8db0077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 --> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8dbc015e50 con 0x7f8db0075520 2024-06-13T11:37:23.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8dbc092050 con 0x7f8dcc06eed0 2024-06-13T11:37:23.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f8dd19fa640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] conn(0x7f8db0075520 0x7f8db0077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f446d298640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f444c06bf00 0x7f444c06e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44640095d0 tx=0x7f4464006b30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f446da99640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] conn(0x7f444c075670 0x7f444c077ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f7432d9d640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] conn(0x7f7418001650 0x7f7418003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7f9bc2053640 1 -- 172.21.15.43:0/2281483205 wait complete. 2024-06-13T11:37:23.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7fd8d2d9d640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] conn(0x7fd8b4076370 0x7fd8b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.471+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8c80557c0 con 0x7fd8d4072850 2024-06-13T11:37:23.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8dd09f8640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8db006be30 0x7f8db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8cb4ff9640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8ca406be30 0x7f8ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8cb008b830 con 0x7f8cb815e950 2024-06-13T11:37:23.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7fd8d1d9b640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd8b406c030 0x7fd8b406e4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4163d60 tx=0x7fd8c4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8dd19fa640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] conn(0x7f8db0075520 0x7f8db0077960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== osd.0 v2:172.21.15.43:6816/302793859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c54078190 con 0x7f7c54075680 2024-06-13T11:37:23.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8cb7fff640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8ca406be30 0x7f8ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== osd.4 v2:172.21.15.53:6824/3698040505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f444c078180 con 0x7f444c075670 2024-06-13T11:37:23.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f7432d9d640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] conn(0x7f7418001650 0x7f7418003b10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8dd09f8640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8db006be30 0x7f8db006e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8006e80 tx=0x7f8dc8006dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8cbe3c1640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] conn(0x7f8cb8147b10 0x7f8cb815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7fd8d2d9d640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] conn(0x7fd8b4076370 0x7fd8b4078810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.472+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/2537735703 --> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cb815c380 con 0x7f8cb8147b10 2024-06-13T11:37:23.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.473+0000 7f8cb7fff640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8ca406be30 0x7f8ca406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034000 tx=0x7f8cac02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.473+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f389c029020 con 0x7f3898005ee0 2024-06-13T11:37:23.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.473+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== osd.6 v2:172.21.15.53:6802/2739056344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7418006bb0 con 0x7f7418001650 2024-06-13T11:37:23.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.473+0000 7f9bc2053640 1 Processor -- start 2024-06-13T11:37:23.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.473+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== osd.3 v2:172.21.15.43:6824/1749988434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8dbc015e50 con 0x7f8db0075520 2024-06-13T11:37:23.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f9bc2053640 1 -- start start 2024-06-13T11:37:23.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== osd.2 v2:172.21.15.43:6800/3687854261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8b4078ee0 con 0x7fd8b4076370 2024-06-13T11:37:23.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38967fc640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f388406be30 0x7f388406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f389c09bd00 con 0x7f3898005ee0 2024-06-13T11:37:23.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38a52ea640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f388406be30 0x7f388406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38967fc640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] conn(0x7f38840754b0 0x7f38840778f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 --> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f389c004460 con 0x7f38840754b0 2024-06-13T11:37:23.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f389c065fc0 con 0x7f3898005ee0 2024-06-13T11:37:23.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f8cb77fe640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] conn(0x7f8cb8147b10 0x7f8cb815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38a62ec640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] conn(0x7f38840754b0 0x7f38840778f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.474+0000 7f38a52ea640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f388406be30 0x7f388406e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3898049c70 tx=0x7f3890009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.475+0000 7f8cb77fe640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] conn(0x7f8cb8147b10 0x7f8cb815be40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.475+0000 7f38a62ec640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] conn(0x7f38840754b0 0x7f38840778f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.476+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== osd.1 v2:172.21.15.43:6808/269259850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ca8009c90 con 0x7f8cb8147b10 2024-06-13T11:37:23.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.476+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== osd.5 v2:172.21.15.53:6816/3644833501 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f389c004460 con 0x7f38840754b0 2024-06-13T11:37:23.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.476+0000 7f9bc2053640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bbc06e500 0x7f9bbc156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.476+0000 7f9bc2053640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9bbc0ce5a0 0x7f9bbc152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.476+0000 7f9bc2053640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc153500 0x7f9bbc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.476+0000 7f9bc2053640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc15f410 con 0x7f9bbc153500 2024-06-13T11:37:23.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bc2053640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc15faa0 con 0x7f9bbc06e500 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bc2053640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f9bbc15f590 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9bbc0ce5a0 0x7f9bbc152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9bbc0ce5a0 0x7f9bbc152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47582/0 (socket says 172.21.15.43:47582) 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 -- 172.21.15.43:0/3999693051 learned_addr learned my addr 172.21.15.43:0/3999693051 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 -- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bbc06e500 msgr2=0x7f9bbc156780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bbc06e500 0x7f9bbc156780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 -- 172.21.15.43:0/3999693051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc153500 msgr2=0x7f9bbc157140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bbc153500 0x7f9bbc157140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 -- 172.21.15.43:0/3999693051 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc157e70 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.477+0000 7f9bbaffd640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9bbc0ce5a0 0x7f9bbc152fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9bb002a700 tx=0x7f9bb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.478+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0044020 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.478+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb0038040 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.478+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0037050 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.478+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bbc158150 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.479+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bbc158710 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.481+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bb0047020 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.482+0000 7f9ba3fff640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9ba806bf00 0x7f9ba806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.482+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9bb00af450 con 0x7f9bbc0ce5a0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.484+0000 7f9ba1ffb640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] conn(0x7f9b9c001650 0x7f9b9c003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.484+0000 7f9ba1ffb640 1 -- 172.21.15.43:0/3999693051 --> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b9c006bb0 con 0x7f9b9c001650 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.484+0000 7f9bbbfff640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] conn(0x7f9b9c001650 0x7f9b9c003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.484+0000 7f9bbb7fe640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9ba806bf00 0x7f9ba806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.485+0000 7f9bbbfff640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] conn(0x7f9b9c001650 0x7f9b9c003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.485+0000 7f9bbb7fe640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9ba806bf00 0x7f9ba806e3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009940 tx=0x7f9bac009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.486+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== osd.7 v2:172.21.15.53:6800/2505473012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b9c006bb0 con 0x7f9b9c001650 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.502+0000 7f7c756ad640 1 -- 172.21.15.43:0/2493734861 --> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c680361d0 con 0x7f7c54075680 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.503+0000 7f7c6cff9640 1 -- 172.21.15.43:0/2493734861 <== osd.0 v2:172.21.15.43:6816/302793859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c680361d0 con 0x7f7c54075680 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.503+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] conn(0x7f7c54075680 msgr2=0x7f7c54077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.504+0000 7f7c5a7fc640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.43:6816/302793859,v1:172.21.15.43:6817/302793859] conn(0x7f7c54075680 0x7f7c54077ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.504+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7c5406bf00 msgr2=0x7f7c5406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.504+0000 7f7c5a7fc640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7c5406bf00 0x7f7c5406e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c6804d0a0 tx=0x7f7c64009190 comp rx=0 tx=0).stop 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.504+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68055b60 msgr2=0x7f7c680e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.504+0000 7f7c5a7fc640 1 --2- 172.21.15.43:0/2493734861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68055b60 0x7f7c680e3480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c7006a140 tx=0x7f7c68052330 comp rx=0 tx=0).stop 2024-06-13T11:37:23.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.504+0000 7f7c74eac640 1 -- 172.21.15.43:0/2493734861 reap_dead start 2024-06-13T11:37:23.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.505+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 shutdown_connections 2024-06-13T11:37:23.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.505+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 >> 172.21.15.43:0/2493734861 conn(0x7f7c68020040 msgr2=0x7f7c680e5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.505+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 shutdown_connections 2024-06-13T11:37:23.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.505+0000 7f7c5a7fc640 1 -- 172.21.15.43:0/2493734861 wait complete. 2024-06-13T11:37:23.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.505+0000 7f44537fe640 1 -- 172.21.15.43:0/2579682448 --> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4460189140 con 0x7f444c075670 2024-06-13T11:37:23.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.506+0000 7f445dffb640 1 -- 172.21.15.43:0/2579682448 <== osd.4 v2:172.21.15.53:6824/3698040505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4460189140 con 0x7f444c075670 2024-06-13T11:37:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] conn(0x7f444c075670 msgr2=0x7f444c077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6824/3698040505,v1:172.21.15.53:6825/3698040505] conn(0x7f444c075670 0x7f444c077ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 --> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8dac002dd0 con 0x7f8db0075520 2024-06-13T11:37:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f444c06bf00 msgr2=0x7f444c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f444c06bf00 0x7f444c06e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f44640095d0 tx=0x7f4464006b30 comp rx=0 tx=0).stop 2024-06-13T11:37:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44600dfd30 msgr2=0x7f44600d7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 --2- 172.21.15.43:0/2579682448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44600dfd30 0x7f44600d7830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f445802a7a0 tx=0x7f44580046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446da99640 1 -- 172.21.15.43:0/2579682448 reap_dead start 2024-06-13T11:37:23.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f8dc1ffb640 1 -- 172.21.15.43:0/3016258471 <== osd.3 v2:172.21.15.43:6824/1749988434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8dac002dd0 con 0x7f8db0075520 2024-06-13T11:37:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 shutdown_connections 2024-06-13T11:37:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 >> 172.21.15.43:0/2579682448 conn(0x7f4460055bd0 msgr2=0x7f44600dba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 --> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7418005c40 con 0x7f7418001650 2024-06-13T11:37:23.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 --> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8b8002dd0 con 0x7fd8b4076370 2024-06-13T11:37:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 shutdown_connections 2024-06-13T11:37:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f446f4fc640 1 -- 172.21.15.43:0/2579682448 wait complete. 2024-06-13T11:37:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.507+0000 7f742affd640 1 -- 172.21.15.43:0/1123289518 <== osd.6 v2:172.21.15.53:6802/2739056344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7418005c40 con 0x7f7418001650 2024-06-13T11:37:23.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] conn(0x7f8db0075520 msgr2=0x7f8db0077960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd345d640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.43:6824/1749988434,v1:172.21.15.43:6825/1749988434] conn(0x7f8db0075520 0x7f8db0077960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7fd8c2ffd640 1 -- 172.21.15.43:0/1129925209 <== osd.2 v2:172.21.15.43:6800/3687854261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8b8002dd0 con 0x7fd8b4076370 2024-06-13T11:37:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8db006be30 msgr2=0x7f8db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd345d640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8db006be30 0x7f8db006e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8006e80 tx=0x7f8dc8006dd0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] conn(0x7f7418001650 msgr2=0x7f7418003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f743880e640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6802/2739056344,v1:172.21.15.53:6804/2739056344] conn(0x7f7418001650 0x7f7418003b10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dcc06eed0 msgr2=0x7f8dcc200590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd345d640 1 --2- 172.21.15.43:0/3016258471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dcc06eed0 0x7f8dcc200590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00b480 tx=0x7f8dbc00b940 comp rx=0 tx=0).stop 2024-06-13T11:37:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] conn(0x7fd8b4076370 msgr2=0x7fd8b4078810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.43:6800/3687854261,v1:172.21.15.43:6801/3687854261] conn(0x7fd8b4076370 0x7fd8b4078810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.508+0000 7f8dd19fa640 1 -- 172.21.15.43:0/3016258471 reap_dead start 2024-06-13T11:37:23.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 shutdown_connections 2024-06-13T11:37:23.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 >> 172.21.15.43:0/3016258471 conn(0x7f8dcc067640 msgr2=0x7f8dcc15df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f741406be60 msgr2=0x7f741406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd8b406c030 msgr2=0x7fd8b406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f741406be60 0x7f741406e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f74341441a0 tx=0x7f741c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd8b406c030 0x7fd8b406e4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4163d60 tx=0x7fd8c4009190 comp rx=0 tx=0).stop 2024-06-13T11:37:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d4072850 msgr2=0x7fd8d41f98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 --2- 172.21.15.43:0/1129925209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d4072850 0x7fd8d41f98f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800b3e0 tx=0x7fd8c800b8a0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cbda0 msgr2=0x7f74341404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 --2- 172.21.15.43:0/1123289518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74340cbda0 0x7f74341404e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f742400d960 tx=0x7f742400de20 comp rx=0 tx=0).stop 2024-06-13T11:37:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d2d9d640 1 -- 172.21.15.43:0/1129925209 reap_dead start 2024-06-13T11:37:23.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 shutdown_connections 2024-06-13T11:37:23.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f8dd345d640 1 -- 172.21.15.43:0/3016258471 wait complete. 2024-06-13T11:37:23.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 shutdown_connections 2024-06-13T11:37:23.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 >> 172.21.15.43:0/1129925209 conn(0x7fd8d40b14b0 msgr2=0x7fd8d40b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 shutdown_connections 2024-06-13T11:37:23.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.510+0000 7fd8d8f77640 1 -- 172.21.15.43:0/1129925209 wait complete. 2024-06-13T11:37:23.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f7432d9d640 1 -- 172.21.15.43:0/1123289518 reap_dead start 2024-06-13T11:37:23.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 shutdown_connections 2024-06-13T11:37:23.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 >> 172.21.15.43:0/1123289518 conn(0x7f7434067820 msgr2=0x7f7434070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 shutdown_connections 2024-06-13T11:37:23.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.509+0000 7f743880e640 1 -- 172.21.15.43:0/1123289518 wait complete. 2024-06-13T11:37:23.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.510+0000 7f8cbe3c1640 1 -- 172.21.15.43:0/2537735703 --> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cb804ffb0 con 0x7f8cb8147b10 2024-06-13T11:37:23.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.510+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 --> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3888002dd0 con 0x7f38840754b0 2024-06-13T11:37:23.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.510+0000 7f8cb4ff9640 1 -- 172.21.15.43:0/2537735703 <== osd.1 v2:172.21.15.43:6808/269259850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8cb804ffb0 con 0x7f8cb8147b10 2024-06-13T11:37:23.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.510+0000 7f38967fc640 1 -- 172.21.15.43:0/1134384790 <== osd.5 v2:172.21.15.53:6816/3644833501 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3888002dd0 con 0x7f38840754b0 2024-06-13T11:37:23.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] conn(0x7f8cb8147b10 msgr2=0x7f8cb815be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.43:6808/269259850,v1:172.21.15.43:6809/269259850] conn(0x7f8cb8147b10 0x7f8cb815be40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8ca406be30 msgr2=0x7f8ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] conn(0x7f38840754b0 msgr2=0x7f38840778f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8ca406be30 0x7f8ca406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034000 tx=0x7f8cac02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:23.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb815e950 msgr2=0x7f8cb815b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 --2- 172.21.15.43:0/2537735703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb815e950 0x7f8cb815b900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000caf0 tx=0x7f8cb000cef0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f38a6aed640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6816/3644833501,v1:172.21.15.53:6817/3644833501] conn(0x7f38840754b0 0x7f38840778f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8cbc95e640 1 -- 172.21.15.43:0/2537735703 reap_dead start 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.511+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 shutdown_connections 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 >> 172.21.15.43:0/2537735703 conn(0x7f8cb80b21f0 msgr2=0x7f8cb80b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f388406be30 msgr2=0x7f388406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f388406be30 0x7f388406e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3898049c70 tx=0x7f3890009040 comp rx=0 tx=0).stop 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898005ee0 msgr2=0x7f38980e5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 --2- 172.21.15.43:0/1134384790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898005ee0 0x7f38980e5960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f389c01c3f0 tx=0x7f389c01c8b0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a62ec640 1 -- 172.21.15.43:0/1134384790 reap_dead start 2024-06-13T11:37:23.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 shutdown_connections 2024-06-13T11:37:23.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 >> 172.21.15.43:0/1134384790 conn(0x7f3898009fb0 msgr2=0x7f38980e9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 shutdown_connections 2024-06-13T11:37:23.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f8c9e7fc640 1 -- 172.21.15.43:0/2537735703 wait complete. 2024-06-13T11:37:23.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 shutdown_connections 2024-06-13T11:37:23.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.512+0000 7f38a6aed640 1 -- 172.21.15.43:0/1134384790 wait complete. 2024-06-13T11:37:23.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.516+0000 7f9ba1ffb640 1 -- 172.21.15.43:0/3999693051 --> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b9c005c90 con 0x7f9b9c001650 2024-06-13T11:37:23.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.517+0000 7f9ba3fff640 1 -- 172.21.15.43:0/3999693051 <== osd.7 v2:172.21.15.53:6800/2505473012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b9c005c90 con 0x7f9b9c001650 2024-06-13T11:37:23.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.518+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] conn(0x7f9b9c001650 msgr2=0x7f9b9c003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.518+0000 7f9bc2053640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6800/2505473012,v1:172.21.15.53:6801/2505473012] conn(0x7f9b9c001650 0x7f9b9c003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.518+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9ba806bf00 msgr2=0x7f9ba806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.518+0000 7f9bc2053640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9ba806bf00 0x7f9ba806e3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009940 tx=0x7f9bac009240 comp rx=0 tx=0).stop 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9bbc0ce5a0 msgr2=0x7f9bbc152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bc2053640 1 --2- 172.21.15.43:0/3999693051 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9bbc0ce5a0 0x7f9bbc152fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9bb002a700 tx=0x7f9bb00046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bbbfff640 1 -- 172.21.15.43:0/3999693051 reap_dead start 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 shutdown_connections 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 >> 172.21.15.43:0/3999693051 conn(0x7f9bbc0673d0 msgr2=0x7f9bbc15c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 shutdown_connections 2024-06-13T11:37:23.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.519+0000 7f9bc2053640 1 -- 172.21.15.43:0/3999693051 wait complete. 2024-06-13T11:37:23.570 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-06-13T11:37:23.570 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-13T11:37:23.571 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:23.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-13T11:37:23.572 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2024-06-13T11:37:23.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-13T11:37:23.573 INFO:teuthology.orchestra.run.smithi043.stdout:60129542152 2024-06-13T11:37:23.573 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-13T11:37:23.574 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-06-13T11:37:23.574 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-13T11:37:23.575 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:23.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-13T11:37:23.576 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:23.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-13T11:37:23.577 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:23.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-13T11:37:23.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.788+0000 7fd919664640 1 Processor -- start 2024-06-13T11:37:23.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.788+0000 7fd919664640 1 -- start start 2024-06-13T11:37:23.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fd919664640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd914165dd0 0x7fd914166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fd919664640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914167250 con 0x7fd91414bf60 2024-06-13T11:37:23.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fd919664640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914164000 con 0x7fd9140d3150 2024-06-13T11:37:23.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fd919664640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd9141642e0 con 0x7fd914165dd0 2024-06-13T11:37:23.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fb63359e640 1 Processor -- start 2024-06-13T11:37:23.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fd9127fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd9140d3150 0x7fd914166490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:49790/0 (socket says 172.21.15.43:49790) 2024-06-13T11:37:23.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7fb63359e640 1 -- start start 2024-06-13T11:37:23.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.790+0000 7fd9127fc640 1 -- 172.21.15.43:0/2281899232 learned_addr learned my addr 172.21.15.43:0/2281899232 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:23.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7fd9137fe640 1 --2- 172.21.15.43:0/2281899232 >> v2:172.21.15.53:3300/0 conn(0x7fd914165dd0 0x7fd914166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7fd9137fe640 1 -- 172.21.15.43:0/2281899232 >> v1:172.21.15.53:6789/0 conn(0x7fd9140d3150 legacy=0x7fd914166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7fd9137fe640 1 -- 172.21.15.43:0/2281899232 >> v1:172.21.15.43:6789/0 conn(0x7fd91414bf60 legacy=0x7fd9140d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7fd9137fe640 1 -- 172.21.15.43:0/2281899232 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9141645c0 con 0x7fd914165dd0 2024-06-13T11:37:23.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7f7f97fff640 1 Processor -- start 2024-06-13T11:37:23.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.791+0000 7f7f97fff640 1 -- start start 2024-06-13T11:37:23.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7f589a72e640 1 Processor -- start 2024-06-13T11:37:23.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fb63359e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fb63359e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb62c053c70 0x7fb62c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fb63359e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb62c033ef0 0x7fb62c04ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7f589a72e640 1 -- start start 2024-06-13T11:37:23.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fb63359e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0544c0 con 0x7fb62c033ef0 2024-06-13T11:37:23.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fb63359e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0541e0 con 0x7fb62c053c70 2024-06-13T11:37:23.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fb63359e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c005f80 con 0x7fb62c0df220 2024-06-13T11:37:23.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.792+0000 7fd9137fe640 1 --2- 172.21.15.43:0/2281899232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd914165dd0 0x7fd914166ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a621ae4141f3117 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f8c01085640 1 Processor -- start 2024-06-13T11:37:23.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f97fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f980cf370 0x7f7f980717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f97fff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f98071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f97fff640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f98072270 con 0x7f7f98148930 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f97fff640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7f98072520 con 0x7f7f980cf370 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f97fff640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7f98072800 con 0x7f7f98148d10 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f977fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f98071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f977fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f98071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47604/0 (socket says 172.21.15.43:47604) 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f977fe640 1 -- 172.21.15.43:0/3802319518 learned_addr learned my addr 172.21.15.43:0/3802319518 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7fd911ffb640 1 -- 172.21.15.43:0/2281899232 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908037070 con 0x7fd914165dd0 2024-06-13T11:37:23.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f7f8e7fc640 1 --2- 172.21.15.43:0/3802319518 >> v2:172.21.15.53:3300/0 conn(0x7f7f980cf370 0x7f7f980717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f7f977fe640 1 -- 172.21.15.43:0/3802319518 >> v2:172.21.15.53:3300/0 conn(0x7f7f980cf370 msgr2=0x7f7f980717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f7f977fe640 1 --2- 172.21.15.43:0/3802319518 >> v2:172.21.15.53:3300/0 conn(0x7f7f980cf370 0x7f7f980717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f7f977fe640 1 -- 172.21.15.43:0/3802319518 >> v1:172.21.15.53:6789/0 conn(0x7f7f98148930 legacy=0x7f7f980cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589a72e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f588c0e3040 0x7f588c03c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589a72e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f588c0e3420 0x7f588c0e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589972c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f588c0e3040 0x7f588c03c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589a72e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588c058980 con 0x7f588c058130 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589a72e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f588c006860 con 0x7f588c0e3040 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589972c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f588c0e3040 0x7f588c03c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47564/0 (socket says 172.21.15.43:47564) 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589972c640 1 -- 172.21.15.43:0/87689492 learned_addr learned my addr 172.21.15.43:0/87689492 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f589a72e640 1 -- 172.21.15.43:0/87689492 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f588c058c60 con 0x7f588c0e3420 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f5898f2b640 1 --2- 172.21.15.43:0/87689492 >> v2:172.21.15.53:3300/0 conn(0x7f588c0e3420 0x7f588c0e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f7f977fe640 1 -- 172.21.15.43:0/3802319518 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f98072ae0 con 0x7f7f98148d10 2024-06-13T11:37:23.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7f8c01085640 1 -- start start 2024-06-13T11:37:23.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f8c01085640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8bfc15f390 0x7f8bfc0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f8c01085640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0aeac0 con 0x7f8bfc071f70 2024-06-13T11:37:23.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f8c01085640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0aac40 con 0x7f8bfc0ae6e0 2024-06-13T11:37:23.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f8c01085640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc15f800 con 0x7f8bfc15f390 2024-06-13T11:37:23.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7f7f8e7fc640 1 --2- 172.21.15.43:0/3802319518 >> v2:172.21.15.53:3300/0 conn(0x7f7f980cf370 0x7f7f980717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:23.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f8c00884640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8bfc15f390 0x7f8bfc0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c038080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47590/0 (socket says 172.21.15.43:47590) 2024-06-13T11:37:23.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 -- 172.21.15.43:0/2892220059 learned_addr learned my addr 172.21.15.43:0/2892220059 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb631d9b640 1 --2- 172.21.15.43:0/2892220059 >> v2:172.21.15.53:3300/0 conn(0x7fb62c053c70 0x7fb62c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb632d9d640 1 --2- 172.21.15.43:0/2892220059 >> v2:172.21.15.43:3300/0 conn(0x7fb62c033ef0 0x7fb62c04ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 -- 172.21.15.43:0/2892220059 >> v2:172.21.15.53:3300/0 conn(0x7fb62c053c70 msgr2=0x7fb62c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 --2- 172.21.15.43:0/2892220059 >> v2:172.21.15.53:3300/0 conn(0x7fb62c053c70 0x7fb62c04fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 -- 172.21.15.43:0/2892220059 >> v2:172.21.15.43:3300/0 conn(0x7fb62c033ef0 msgr2=0x7fb62c04ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 --2- 172.21.15.43:0/2892220059 >> v2:172.21.15.43:3300/0 conn(0x7fb62c033ef0 0x7fb62c04ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.793+0000 7fb63259c640 1 -- 172.21.15.43:0/2892220059 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c006260 con 0x7fb62c0df220 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f8bfbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8bfc0ae6e0 0x7f8bfc071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:49802/0 (socket says 172.21.15.43:49802) 2024-06-13T11:37:23.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f8bfbfff640 1 -- 172.21.15.43:0/1101274722 learned_addr learned my addr 172.21.15.43:0/1101274722 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:23.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fb63259c640 1 --2- 172.21.15.43:0/2892220059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c038080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0524d0 tx=0x7fb62400a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ca2a77882b877f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.794+0000 7fd911ffb640 1 -- 172.21.15.43:0/2281899232 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908032440 con 0x7fd914165dd0 2024-06-13T11:37:23.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f7f977fe640 1 --2- 172.21.15.43:0/3802319518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f98071d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009e50 tx=0x7f7f9002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae7ba295b407057 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f8c00884640 1 -- 172.21.15.43:0/1101274722 >> v1:172.21.15.53:6789/0 conn(0x7f8bfc0ae6e0 legacy=0x7f8bfc071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f8c00884640 1 -- 172.21.15.43:0/1101274722 >> v1:172.21.15.43:6789/0 conn(0x7f8bfc071f70 legacy=0x7f8bfc0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f8c00884640 1 -- 172.21.15.43:0/1101274722 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc0aaf20 con 0x7f8bfc15f390 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fd919664640 1 -- 172.21.15.43:0/2281899232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd914165dd0 msgr2=0x7fd914166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fd919664640 1 --2- 172.21.15.43:0/2281899232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd914165dd0 0x7fd914166ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802a230 comp rx=0 tx=0).stop 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fd919664640 1 -- 172.21.15.43:0/2281899232 shutdown_connections 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fd919664640 1 --2- 172.21.15.43:0/2281899232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd914165dd0 0x7fd914166ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fd919664640 1 -- 172.21.15.43:0/2281899232 >> 172.21.15.43:0/2281899232 conn(0x7fd914067640 msgr2=0x7fd9140d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f589972c640 1 -- 172.21.15.43:0/87689492 >> v2:172.21.15.53:3300/0 conn(0x7f588c0e3420 msgr2=0x7f588c0e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f589972c640 1 --2- 172.21.15.43:0/87689492 >> v2:172.21.15.53:3300/0 conn(0x7f588c0e3420 0x7f588c0e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f589972c640 1 -- 172.21.15.43:0/87689492 >> v1:172.21.15.43:6789/0 conn(0x7f588c058130 legacy=0x7f588c053d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7f589972c640 1 -- 172.21.15.43:0/87689492 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588c006210 con 0x7f588c0e3040 2024-06-13T11:37:23.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.795+0000 7fb63159a640 1 -- 172.21.15.43:0/2892220059 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624038070 con 0x7fb62c0df220 2024-06-13T11:37:23.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f589972c640 1 --2- 172.21.15.43:0/87689492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c03c180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5894069ec0 tx=0x7f58940a5090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8af698385b584bb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7fb63159a640 1 -- 172.21.15.43:0/2892220059 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb624030480 con 0x7fb62c0df220 2024-06-13T11:37:23.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7fb63159a640 1 -- 172.21.15.43:0/2892220059 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624030890 con 0x7fb62c0df220 2024-06-13T11:37:23.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f7f967fc640 1 -- 172.21.15.43:0/3802319518 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90036070 con 0x7f7f98148d10 2024-06-13T11:37:23.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f7f967fc640 1 -- 172.21.15.43:0/3802319518 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f90031600 con 0x7f7f98148d10 2024-06-13T11:37:23.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f7f967fc640 1 -- 172.21.15.43:0/3802319518 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900319d0 con 0x7f7f98148d10 2024-06-13T11:37:23.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f91ecfa2640 1 Processor -- start 2024-06-13T11:37:23.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f588bfff640 1 -- 172.21.15.43:0/87689492 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940b2070 con 0x7f588c0e3040 2024-06-13T11:37:23.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f588bfff640 1 -- 172.21.15.43:0/87689492 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58940a5de0 con 0x7f588c0e3040 2024-06-13T11:37:23.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f588bfff640 1 -- 172.21.15.43:0/87689492 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940ad640 con 0x7f588c0e3040 2024-06-13T11:37:23.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 -- 172.21.15.43:0/3802319518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 msgr2=0x7f7f98071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 --2- 172.21.15.43:0/3802319518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f98071d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009e50 tx=0x7f7f9002a6d0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.796+0000 7f91ecfa2640 1 -- start start 2024-06-13T11:37:23.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f8c00884640 1 --2- 172.21.15.43:0/1101274722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc0aa4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009d90 tx=0x7f8bf402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaaab986b24d3739 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fb63359e640 1 -- 172.21.15.43:0/2892220059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 msgr2=0x7fb62c038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fb63359e640 1 --2- 172.21.15.43:0/2892220059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c038080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0524d0 tx=0x7fb62400a250 comp rx=0 tx=0).stop 2024-06-13T11:37:23.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 -- 172.21.15.43:0/3802319518 shutdown_connections 2024-06-13T11:37:23.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 --2- 172.21.15.43:0/3802319518 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f98071d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 --2- 172.21.15.43:0/3802319518 >> v2:172.21.15.53:3300/0 conn(0x7f7f980cf370 0x7f7f980717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 -- 172.21.15.43:0/3802319518 >> 172.21.15.43:0/3802319518 conn(0x7f7f980b2810 msgr2=0x7f7f980b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fd919664640 1 -- 172.21.15.43:0/2281899232 shutdown_connections 2024-06-13T11:37:23.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fd919664640 1 -- 172.21.15.43:0/2281899232 wait complete. 2024-06-13T11:37:23.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 -- 172.21.15.43:0/3802319518 shutdown_connections 2024-06-13T11:37:23.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fb63359e640 1 -- 172.21.15.43:0/2892220059 shutdown_connections 2024-06-13T11:37:23.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fb63359e640 1 --2- 172.21.15.43:0/2892220059 >> v2:172.21.15.43:3300/0 conn(0x7fb62c033ef0 0x7fb62c04ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fb63359e640 1 --2- 172.21.15.43:0/2892220059 >> v2:172.21.15.53:3300/0 conn(0x7fb62c053c70 0x7fb62c04fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fb63359e640 1 --2- 172.21.15.43:0/2892220059 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c038080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f8bfaffd640 1 -- 172.21.15.43:0/1101274722 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4007740 con 0x7f8bfc15f390 2024-06-13T11:37:23.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f589a72e640 1 -- 172.21.15.43:0/87689492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 msgr2=0x7f588c03c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f589a72e640 1 --2- 172.21.15.43:0/87689492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c03c180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5894069ec0 tx=0x7f58940a5090 comp rx=0 tx=0).stop 2024-06-13T11:37:23.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fea9e310640 1 Processor -- start 2024-06-13T11:37:23.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7fea9e310640 1 -- start start 2024-06-13T11:37:23.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f8bfaffd640 1 -- 172.21.15.43:0/1101274722 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf40078e0 con 0x7f8bfc15f390 2024-06-13T11:37:23.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f589a72e640 1 -- 172.21.15.43:0/87689492 shutdown_connections 2024-06-13T11:37:23.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f589a72e640 1 --2- 172.21.15.43:0/87689492 >> v2:172.21.15.53:3300/0 conn(0x7f588c0e3420 0x7f588c0e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f589a72e640 1 --2- 172.21.15.43:0/87689492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c03c180 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f589a72e640 1 -- 172.21.15.43:0/87689492 >> 172.21.15.43:0/87689492 conn(0x7f588c03aa40 msgr2=0x7f588c03ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f7f97fff640 1 -- 172.21.15.43:0/3802319518 wait complete. 2024-06-13T11:37:23.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.797+0000 7f8bfaffd640 1 -- 172.21.15.43:0/1101274722 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4007cf0 con 0x7f8bfc15f390 2024-06-13T11:37:23.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f589a72e640 1 -- 172.21.15.43:0/87689492 shutdown_connections 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7fb63359e640 1 -- 172.21.15.43:0/2892220059 >> 172.21.15.43:0/2892220059 conn(0x7fb62c009fb0 msgr2=0x7fb62c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f589a72e640 1 -- 172.21.15.43:0/87689492 wait complete. 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f91ecfa2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f91e80d2a90 0x7f91e80d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f91ecfa2640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e80abe00 0x7f91e80ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f91ecfa2640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e80aa5d0 con 0x7f91e8155420 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f91ecfa2640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f91e80d3440 con 0x7f91e80d2a90 2024-06-13T11:37:23.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f91ecfa2640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f91e80aeb90 con 0x7f91e80abe00 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f8c01085640 1 -- 172.21.15.43:0/1101274722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 msgr2=0x7f8bfc0aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f8c01085640 1 --2- 172.21.15.43:0/1101274722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc0aa4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009d90 tx=0x7f8bf402a6c0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f8c01085640 1 -- 172.21.15.43:0/1101274722 shutdown_connections 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f8c01085640 1 --2- 172.21.15.43:0/1101274722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc0aa4a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7f8c01085640 1 -- 172.21.15.43:0/1101274722 >> 172.21.15.43:0/1101274722 conn(0x7f8bfc0d0f20 msgr2=0x7f8bfc0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7fb63359e640 1 -- 172.21.15.43:0/2892220059 shutdown_connections 2024-06-13T11:37:23.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.798+0000 7fb63359e640 1 -- 172.21.15.43:0/2892220059 wait complete. 2024-06-13T11:37:23.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f91e6d9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e80abe00 0x7f91e80ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7fea9e310640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea98148e50 0x7fea980d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f91e6d9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e80abe00 0x7f91e80ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47612/0 (socket says 172.21.15.43:47612) 2024-06-13T11:37:23.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f8c01085640 1 -- 172.21.15.43:0/1101274722 shutdown_connections 2024-06-13T11:37:23.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f8c01085640 1 -- 172.21.15.43:0/1101274722 wait complete. 2024-06-13T11:37:23.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f7f97fff640 1 Processor -- start 2024-06-13T11:37:23.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7fea97fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea98148e50 0x7fea980d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7fea97fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea98148e50 0x7fea980d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47578/0 (socket says 172.21.15.43:47578) 2024-06-13T11:37:23.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f7f97fff640 1 -- start start 2024-06-13T11:37:23.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7fea97fff640 1 -- 172.21.15.43:0/1101291307 learned_addr learned my addr 172.21.15.43:0/1101291307 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7fea9e310640 1 --2- 172.21.15.43:0/1101291307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea980d1e60 0x7fea980ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7fea9e310640 1 --2- 172.21.15.43:0/1101291307 >> v2:172.21.15.53:3300/0 conn(0x7fea980ce6a0 0x7fea981664e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fea977fe640 1 --2- 172.21.15.43:0/1101291307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea980d1e60 0x7fea980ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fd919664640 1 Processor -- start 2024-06-13T11:37:23.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7f589a72e640 1 Processor -- start 2024-06-13T11:37:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f24a556a640 1 Processor -- start 2024-06-13T11:37:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f24a556a640 1 -- start start 2024-06-13T11:37:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fd919664640 1 -- start start 2024-06-13T11:37:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fea980d0ed0 con 0x7fea98148e50 2024-06-13T11:37:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fea98149230 con 0x7fea980ce6a0 2024-06-13T11:37:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fea980d02c0 con 0x7fea980d1e60 2024-06-13T11:37:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fea9c8ad640 1 --2- 172.21.15.43:0/1101291307 >> v2:172.21.15.53:3300/0 conn(0x7fea980ce6a0 0x7fea981664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f7f97fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f980cf370 0x7f7f9815fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f24a556a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24a0148e40 0x7f24a0070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7fb63359e640 1 Processor -- start 2024-06-13T11:37:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fb63359e640 1 -- start start 2024-06-13T11:37:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f24a556a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a0167280 con 0x7f24a0072bc0 2024-06-13T11:37:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f24a556a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a00cca40 con 0x7f24a0072fa0 2024-06-13T11:37:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f24a556a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f24a00ccd20 con 0x7f24a0148e40 2024-06-13T11:37:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f7f97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98148930 0x7f7f980c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fd919664640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 0x7fd9140d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7f589a72e640 1 -- start start 2024-06-13T11:37:23.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f589a72e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 0x7f588c0e4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fd919664640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd91414bf60 0x7fd91406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f589a72e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c1779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f7f97fff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f980c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fd919664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd914165dd0 0x7fd914143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589a72e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f588c0e3420 0x7f588c0e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f96ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f980cf370 0x7f7f9815fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f96ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f980cf370 0x7f7f9815fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47586/0 (socket says 172.21.15.43:47586) 2024-06-13T11:37:23.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd919664640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd91416d720 con 0x7fd914165dd0 2024-06-13T11:37:23.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd919664640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd91414c340 con 0x7fd9140d3150 2024-06-13T11:37:23.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f96ffd640 1 -- 172.21.15.43:0/3048545406 learned_addr learned my addr 172.21.15.43:0/3048545406 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd919664640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd91416d8a0 con 0x7fd91414bf60 2024-06-13T11:37:23.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589a72e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f588c0586f0 con 0x7f588c0e3040 2024-06-13T11:37:23.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589a72e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f588c058570 con 0x7f588c058130 2024-06-13T11:37:23.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589a72e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f588c0544a0 con 0x7f588c0e3420 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 0x7f588c0e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 0x7f588c0e4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43242/0 (socket says 172.21.15.43:43242) 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 -- 172.21.15.43:0/2839288758 learned_addr learned my addr 172.21.15.43:0/2839288758 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f5898f2b640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c1779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f977fe640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f980c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f980cd200 con 0x7f7f980cf370 2024-06-13T11:37:23.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f980730a0 con 0x7f7f98148930 2024-06-13T11:37:23.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7f980cd380 con 0x7f7f98148d10 2024-06-13T11:37:23.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fea977fe640 1 -- 172.21.15.43:0/1101291307 >> v2:172.21.15.53:3300/0 conn(0x7fea980ce6a0 msgr2=0x7fea981664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fea977fe640 1 --2- 172.21.15.43:0/1101291307 >> v2:172.21.15.53:3300/0 conn(0x7fea980ce6a0 0x7fea981664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fea977fe640 1 -- 172.21.15.43:0/1101291307 >> v2:172.21.15.43:3300/0 conn(0x7fea98148e50 msgr2=0x7fea980d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fea977fe640 1 --2- 172.21.15.43:0/1101291307 >> v2:172.21.15.43:3300/0 conn(0x7fea98148e50 0x7fea980d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7fea977fe640 1 -- 172.21.15.43:0/1101291307 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea980d05a0 con 0x7fea980d1e60 2024-06-13T11:37:23.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd9137fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd914165dd0 0x7fd914143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd912ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 0x7fd9140d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 -- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f588c0e3420 msgr2=0x7f588c0e0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f249f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24a0148e40 0x7f24a0070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f249f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f24a0148e40 0x7f24a0070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47604/0 (socket says 172.21.15.43:47604) 2024-06-13T11:37:23.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f249f7fe640 1 -- 172.21.15.43:0/3115304058 learned_addr learned my addr 172.21.15.43:0/3115304058 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f5899f2d640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f588c0e3420 0x7f588c0e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f588c0e3420 0x7f588c0e0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 -- 172.21.15.43:0/2839288758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 msgr2=0x7f588c1779b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd912ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 0x7fd9140d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43228/0 (socket says 172.21.15.43:43228) 2024-06-13T11:37:23.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fd912ffd640 1 -- 172.21.15.43:0/3064135523 learned_addr learned my addr 172.21.15.43:0/3064135523 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fea977fe640 1 --2- 172.21.15.43:0/1101291307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea980d1e60 0x7fea980ce160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea980b4f50 tx=0x7fea8c02a120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6637e4762648391 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f249f7fe640 1 -- 172.21.15.43:0/3115304058 >> v1:172.21.15.53:6789/0 conn(0x7f24a0072fa0 legacy=0x7f24a0148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f249f7fe640 1 -- 172.21.15.43:0/3115304058 >> v1:172.21.15.43:6789/0 conn(0x7f24a0072bc0 legacy=0x7f24a00cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f7f8e7fc640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98148930 0x7f7f980c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c1779b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f589972c640 1 -- 172.21.15.43:0/2839288758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588c17eaa0 con 0x7f588c058130 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.799+0000 7f91e6d9d640 1 -- 172.21.15.43:0/411709883 learned_addr learned my addr 172.21.15.43:0/411709883 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328750494 0 0) 0x7f91e80aa5d0 con 0x7f91e8155420 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.800+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d0003520 con 0x7f91e8155420 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3619502625 0 0) 0x7f91d0003520 con 0x7f91e8155420 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e80abe00 msgr2=0x7f91e80ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e80abe00 0x7f91e80ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 >> v2:172.21.15.43:3300/0 conn(0x7f91e80d2a90 msgr2=0x7f91e80d2f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e5d9b640 1 --2- 172.21.15.43:0/411709883 >> v2:172.21.15.43:3300/0 conn(0x7f91e80d2a90 0x7f91e80d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 --2- 172.21.15.43:0/411709883 >> v2:172.21.15.43:3300/0 conn(0x7f91e80d2a90 0x7f91e80d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e8155800 con 0x7f91e8155420 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f91dc001650 con 0x7f91e8155420 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 >> v1:172.21.15.43:6789/0 conn(0x7f91e8155420 legacy=0x7f91e80ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91d0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91d0004800 0x7f91d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91d00051c0 0x7f91d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80d3440 con 0x7f91d00039f0 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80aeb90 con 0x7f91d0004800 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f91d000c170 con 0x7f91d00051c0 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f91e659c640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91d0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f91e5d9b640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91d0004800 0x7f91d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fb63359e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c033ef0 0x7fb62c0d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7fb63359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c053c70 0x7fb62c04ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63359e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c04d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63359e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c037a90 con 0x7fb62c033ef0 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63359e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c037910 con 0x7fb62c053c70 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63359e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c0df600 con 0x7fb62c0df220 2024-06-13T11:37:23.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd9127fc640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd91414bf60 0x7fd91406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f8c01085640 1 Processor -- start 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.801+0000 7f8c01085640 1 -- start start 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f8c01085640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 0x7f8bfc08b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f8c01085640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bfc0ae6e0 0x7f8bfc1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.802+0000 7f8c01085640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8c01085640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0ab4e0 con 0x7f8bfc0ae6e0 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8c01085640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0aa9e0 con 0x7f8bfc15f390 2024-06-13T11:37:23.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8c01085640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc0ab7c0 con 0x7f8bfc071f70 2024-06-13T11:37:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f249f7fe640 1 -- 172.21.15.43:0/3115304058 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a00cd000 con 0x7f24a0148e40 2024-06-13T11:37:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 0x7f8bfc08b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 0x7f8bfc08b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47658/0 (socket says 172.21.15.43:47658) 2024-06-13T11:37:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8bfbfff640 1 -- 172.21.15.43:0/442940383 learned_addr learned my addr 172.21.15.43:0/442940383 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f5898f2b640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c1779b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:23.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f5899f2d640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f588c0e3420 0x7f588c0e0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f91e6d9d640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91d00051c0 0x7f91d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8c00884640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f8bfb7fe640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bfc0ae6e0 0x7f8bfc1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f7f977fe640 1 -- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98148930 msgr2=0x7f7f980c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f7f977fe640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98148930 0x7f7f980c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f7f977fe640 1 -- 172.21.15.43:0/3048545406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f980cf370 msgr2=0x7f7f9815fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f7f977fe640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f980cf370 0x7f7f9815fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f7f977fe640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f981602a0 con 0x7f7f98148d10 2024-06-13T11:37:23.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fea96ffd640 1 -- 172.21.15.43:0/1101291307 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c037070 con 0x7fea980d1e60 2024-06-13T11:37:23.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f589972c640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 0x7f588c0e4990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5894069ec0 tx=0x7f589406b250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fea96ffd640 1 -- 172.21.15.43:0/1101291307 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c032440 con 0x7fea980d1e60 2024-06-13T11:37:23.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd912ffd640 1 -- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd91414bf60 msgr2=0x7fd91406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd912ffd640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd91414bf60 0x7fd91406d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd912ffd640 1 -- 172.21.15.43:0/3064135523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd914165dd0 msgr2=0x7fd914143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd912ffd640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd914165dd0 0x7fd914143fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd912ffd640 1 -- 172.21.15.43:0/3064135523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9140d1140 con 0x7fd9140d3150 2024-06-13T11:37:23.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c033ef0 0x7fb62c0d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb631d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c053c70 0x7fb62c04ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c033ef0 0x7fb62c0d83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47610/0 (socket says 172.21.15.43:47610) 2024-06-13T11:37:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fb63259c640 1 -- 172.21.15.43:0/489571446 learned_addr learned my addr 172.21.15.43:0/489571446 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fea96ffd640 1 -- 172.21.15.43:0/1101291307 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c032850 con 0x7fea980d1e60 2024-06-13T11:37:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940c2070 con 0x7f588c058130 2024-06-13T11:37:23.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7f7f977fe640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f980c6e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f90030000 tx=0x7f7f90004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.803+0000 7fd912ffd640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 0x7fd9140d1f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd90400c480 tx=0x7fd90400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fb632d9d640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c04d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f589a72e640 1 -- 172.21.15.43:0/2839288758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588c0e3bd0 con 0x7f588c058130 2024-06-13T11:37:23.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f91e659c640 1 -- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91d00051c0 msgr2=0x7f91d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f91e659c640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91d00051c0 0x7f91d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9040052d0 con 0x7fd9140d3150 2024-06-13T11:37:23.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd904005470 con 0x7fd9140d3150 2024-06-13T11:37:23.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904012850 con 0x7fd9140d3150 2024-06-13T11:37:23.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9140d1420 con 0x7fd9140d3150 2024-06-13T11:37:23.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f91e659c640 1 -- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91d0004800 msgr2=0x7f91d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:23.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f91e659c640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91d0004800 0x7f91d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f589a72e640 1 -- 172.21.15.43:0/2839288758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588c0e4190 con 0x7f588c058130 2024-06-13T11:37:23.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f91e659c640 1 -- 172.21.15.43:0/411709883 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e8155800 con 0x7f91d00039f0 2024-06-13T11:37:23.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fb631d9b640 1 -- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 msgr2=0x7fb62c04d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fb631d9b640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c04d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fb631d9b640 1 -- 172.21.15.43:0/489571446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c033ef0 msgr2=0x7fb62c0d83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fb631d9b640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c033ef0 0x7fb62c0d83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fb631d9b640 1 -- 172.21.15.43:0/489571446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c0d9e60 con 0x7fb62c053c70 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58940b7070 con 0x7f588c058130 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940b2040 con 0x7f588c058130 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90036050 con 0x7f7f98148d10 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f90042070 con 0x7f7f98148d10 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90009510 con 0x7f7f98148d10 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f980c5d70 con 0x7f7f98148d10 2024-06-13T11:37:23.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f980c6330 con 0x7f7f98148d10 2024-06-13T11:37:23.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9140d19e0 con 0x7fd9140d3150 2024-06-13T11:37:23.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8bfbfff640 1 -- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 msgr2=0x7f8bfc159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8bfbfff640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8bfbfff640 1 -- 172.21.15.43:0/442940383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bfc0ae6e0 msgr2=0x7f8bfc1518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8c00884640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8bfbfff640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bfc0ae6e0 0x7f8bfc1518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8bfbfff640 1 -- 172.21.15.43:0/442940383 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc14f430 con 0x7f8bfc071f70 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.804+0000 7f8bfb7fe640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bfc0ae6e0 0x7f8bfc1518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.805+0000 7fb631d9b640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c053c70 0x7fb62c04ce50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb62800d610 tx=0x7fb62800dad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7f249f7fe640 1 --2- 172.21.15.43:0/3115304058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0148e40 0x7f24a0070810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2498009e50 tx=0x7f249802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9672a8562986d0d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58940c5070 con 0x7f588c058130 2024-06-13T11:37:23.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.805+0000 7f91e659c640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91d0003e30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00c290 tx=0x7f91d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f034591a38c33ab server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.805+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea980d1e60 msgr2=0x7fea980ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.805+0000 7fea9e310640 1 --2- 172.21.15.43:0/1101291307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea980d1e60 0x7fea980ce160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea980b4f50 tx=0x7fea8c02a120 comp rx=0 tx=0).stop 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.805+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 shutdown_connections 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.805+0000 7fea9e310640 1 --2- 172.21.15.43:0/1101291307 >> v2:172.21.15.53:3300/0 conn(0x7fea980ce6a0 0x7fea981664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fea9e310640 1 --2- 172.21.15.43:0/1101291307 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea980d1e60 0x7fea980ce160 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea980b4f50 tx=0x7fea8c02a120 comp rx=0 tx=0).stop 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fea9e310640 1 --2- 172.21.15.43:0/1101291307 >> v2:172.21.15.43:3300/0 conn(0x7fea98148e50 0x7fea980d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 >> 172.21.15.43:0/1101291307 conn(0x7fea98070810 msgr2=0x7fea98070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 shutdown_connections 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fea9e310640 1 -- 172.21.15.43:0/1101291307 wait complete. 2024-06-13T11:37:23.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62801a070 con 0x7fb62c053c70 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62800c660 con 0x7fb62c053c70 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62800ca30 con 0x7fb62c053c70 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c0d7e50 con 0x7fb62c053c70 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c0da3e0 con 0x7fb62c053c70 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7f249e7fc640 1 -- 172.21.15.43:0/3115304058 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498036070 con 0x7f24a0148e40 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7f249e7fc640 1 -- 172.21.15.43:0/3115304058 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2498031600 con 0x7f24a0148e40 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.806+0000 7f249e7fc640 1 -- 172.21.15.43:0/3115304058 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24980319d0 con 0x7f24a0148e40 2024-06-13T11:37:23.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f5889ffb640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f587806bf00 0x7f587806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f589a72e640 1 -- 172.21.15.43:0/2839288758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5874005290 con 0x7f588c058130 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5894126e10 con 0x7f588c058130 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc007ce0 con 0x7f91d00039f0 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91dc005270 con 0x7f91d00039f0 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f91e559a640 1 -- 172.21.15.43:0/411709883 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc007ce0 con 0x7f91d00039f0 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f24a556a640 1 -- 172.21.15.43:0/3115304058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0148e40 msgr2=0x7f24a0070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f24a556a640 1 --2- 172.21.15.43:0/3115304058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0148e40 0x7f24a0070810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2498009e50 tx=0x7f249802a6a0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.807+0000 7f8bfbfff640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 0x7f8bfc08b920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000c4d0 tx=0x7f8bf000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f90007bf0 con 0x7f7f98148d10 2024-06-13T11:37:23.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f24a556a640 1 -- 172.21.15.43:0/3115304058 shutdown_connections 2024-06-13T11:37:23.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f24a556a640 1 --2- 172.21.15.43:0/3115304058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0148e40 0x7f24a0070810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f24a556a640 1 -- 172.21.15.43:0/3115304058 >> 172.21.15.43:0/3115304058 conn(0x7f24a00b14b0 msgr2=0x7f24a00b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9040129f0 con 0x7fd9140d3150 2024-06-13T11:37:23.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f9804fcb0 con 0x7f7f98148d10 2024-06-13T11:37:23.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f24a556a640 1 -- 172.21.15.43:0/3115304058 shutdown_connections 2024-06-13T11:37:23.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f24a556a640 1 -- 172.21.15.43:0/3115304058 wait complete. 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f7f8ffff640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7f7c06bf00 0x7f7f7c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7f900abfa0 con 0x7f7f98148d10 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f7f96ffd640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7f7c06bf00 0x7f7f7c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f91ecfa2640 1 -- 172.21.15.43:0/411709883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 msgr2=0x7f91d0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/411709883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91d0003e30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00c290 tx=0x7f91d0005830 comp rx=0 tx=0).stop 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f91e6d9d640 1 -- 172.21.15.43:0/411709883 reap_dead start 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f91ecfa2640 1 -- 172.21.15.43:0/411709883 shutdown_connections 2024-06-13T11:37:23.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f91ecfa2640 1 -- 172.21.15.43:0/411709883 >> 172.21.15.43:0/411709883 conn(0x7f91e8067640 msgr2=0x7f91e80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00058b0 con 0x7f8bfc071f70 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf0019070 con 0x7f8bfc071f70 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0005c70 con 0x7f8bfc071f70 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc1521c0 con 0x7f8bfc071f70 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc14fcb0 con 0x7f8bfc071f70 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb618005290 con 0x7fb62c053c70 2024-06-13T11:37:23.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f91ecfa2640 1 -- 172.21.15.43:0/411709883 shutdown_connections 2024-06-13T11:37:23.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7fea9e310640 1 Processor -- start 2024-06-13T11:37:23.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7fea9e310640 1 -- start start 2024-06-13T11:37:23.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.808+0000 7f5898f2b640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f587806bf00 0x7f587806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7f91ecfa2640 1 -- 172.21.15.43:0/411709883 wait complete. 2024-06-13T11:37:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9140d2500 con 0x7fd9140d3150 2024-06-13T11:37:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7fd8fb7fe640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd90006be30 0x7fd90006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.809+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd90408ae30 con 0x7fd9140d3150 2024-06-13T11:37:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7f5898f2b640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f587806bf00 0x7f587806e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f588c012370 tx=0x7f5890008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb62801d070 con 0x7fb62c053c70 2024-06-13T11:37:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7fd9127fc640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd90006be30 0x7fd90006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7f24a556a640 1 Processor -- start 2024-06-13T11:37:23.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7f7f96ffd640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7f7c06bf00 0x7f7f7c06e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7f800018b0 tx=0x7f7f80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.810+0000 7f24a556a640 1 -- start start 2024-06-13T11:37:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fd9127fc640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd90006be30 0x7fd90006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9141fbbf0 tx=0x7fd90c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9e310640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 0x7fea9813dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fb622ffd640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb61406be80 0x7fb61406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9e310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea98148e50 0x7fea9814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9e310640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea981424b0 0x7fea98149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7f91ecfa2640 1 Processor -- start 2024-06-13T11:37:23.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9e310640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea98163dc0 con 0x7fea980ce6a0 2024-06-13T11:37:23.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9e310640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea980d0b60 con 0x7fea98148e50 2024-06-13T11:37:23.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9e310640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fea980d1360 con 0x7fea981424b0 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7f24a556a640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 0x7f24a01f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f24a556a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0072fa0 0x7f24a015fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea97fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 0x7fea9813dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea97fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 0x7fea9813dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47622/0 (socket says 172.21.15.43:47622) 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea97fff640 1 -- 172.21.15.43:0/2888609481 learned_addr learned my addr 172.21.15.43:0/2888609481 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fea9c8ad640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea981424b0 0x7fea98149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f24a556a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24a0148e40 0x7f24a006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.811+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb62808a510 con 0x7fb62c053c70 2024-06-13T11:37:23.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f24a556a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0071160 con 0x7f24a0072fa0 2024-06-13T11:37:23.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f24a556a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0070fe0 con 0x7f24a0148e40 2024-06-13T11:37:23.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f24a556a640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f24a00712e0 con 0x7f24a0072bc0 2024-06-13T11:37:23.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f249effd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 0x7f24a01f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bdc005290 con 0x7f8bfc071f70 2024-06-13T11:37:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f249effd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 0x7f24a01f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47678/0 (socket says 172.21.15.43:47678) 2024-06-13T11:37:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f249effd640 1 -- 172.21.15.43:0/1937266417 learned_addr learned my addr 172.21.15.43:0/1937266417 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f249f7fe640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24a0148e40 0x7f24a006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f91ecfa2640 1 -- start start 2024-06-13T11:37:23.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea977fe640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea98148e50 0x7fea9814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fb63259c640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb61406be80 0x7fb61406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f2497fff640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0072fa0 0x7f24a015fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea9c8ad640 1 -- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea98148e50 msgr2=0x7fea9814bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea9c8ad640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea98148e50 0x7fea9814bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea9c8ad640 1 -- 172.21.15.43:0/2888609481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 msgr2=0x7fea9813dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea9c8ad640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 0x7fea9813dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea9c8ad640 1 -- 172.21.15.43:0/2888609481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea98142a70 con 0x7fea981424b0 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7fea97fff640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 0x7fea9813dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f2497fff640 1 -- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 msgr2=0x7f24a01f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f2497fff640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 0x7f24a01f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f2497fff640 1 -- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24a0148e40 msgr2=0x7f24a006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7fea9c8ad640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea981424b0 0x7fea98149980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea980b37c0 tx=0x7fea8800d9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f2497fff640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24a0148e40 0x7f24a006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f2497fff640 1 -- 172.21.15.43:0/1937266417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a0160400 con 0x7f24a0072fa0 2024-06-13T11:37:23.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.812+0000 7f249effd640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 0x7f24a01f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7fb63259c640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb61406be80 0x7fb61406e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb62400a6d0 tx=0x7fb62402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7f2497fff640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0072fa0 0x7f24a015fae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f248800c3c0 tx=0x7f248800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488017070 con 0x7f24a0072fa0 2024-06-13T11:37:23.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24880052d0 con 0x7f24a0072fa0 2024-06-13T11:37:23.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488003830 con 0x7f24a0072fa0 2024-06-13T11:37:23.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a01606c0 con 0x7f24a0072fa0 2024-06-13T11:37:23.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.813+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a0160c80 con 0x7f24a0072fa0 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91ecfa2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91e80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91ecfa2640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e8156b60 0x7f91e8157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91ecfa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 0x7f91e8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91ecfa2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80aae30 con 0x7f91d00039f0 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91ecfa2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80aab50 con 0x7f91e8156fc0 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91ecfa2640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f91e80ab110 con 0x7f91e8156b60 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 0x7f91e8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 0x7f91e8152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43318/0 (socket says 172.21.15.43:43318) 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 -- 172.21.15.43:0/4283470827 learned_addr learned my addr 172.21.15.43:0/4283470827 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e5d9b640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e8156b60 0x7f91e8157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e659c640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91e80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 -- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e8156b60 msgr2=0x7f91e8157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e8156b60 0x7f91e8157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 -- 172.21.15.43:0/4283470827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 msgr2=0x7f91e80d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91e80d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e6d9d640 1 -- 172.21.15.43:0/4283470827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e8155ac0 con 0x7f91e8156fc0 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.814+0000 7f91e5d9b640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e8156b60 0x7f91e8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.815+0000 7f91e6d9d640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 0x7f91e8152cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91e80d0fd0 tx=0x7f91e0007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.815+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a004ffb0 con 0x7f24a0072fa0 2024-06-13T11:37:23.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.815+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f248801a070 con 0x7f24a0072fa0 2024-06-13T11:37:23.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.815+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f58940f4fc0 con 0x7f588c058130 2024-06-13T11:37:23.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7f981602a0 con 0x7f7f98148d10 2024-06-13T11:37:23.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880125f0 con 0x7fea981424b0 2024-06-13T11:37:23.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88019070 con 0x7fea981424b0 2024-06-13T11:37:23.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea98142d50 con 0x7fea981424b0 2024-06-13T11:37:23.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7f24977fe640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f248006be30 0x7f248006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880129b0 con 0x7fea981424b0 2024-06-13T11:37:23.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea98143310 con 0x7fea981424b0 2024-06-13T11:37:23.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.816+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f248808a410 con 0x7f24a0072fa0 2024-06-13T11:37:23.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.817+0000 7f249effd640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f248006be30 0x7f248006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.818+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9804ffb0 con 0x7fea981424b0 2024-06-13T11:37:23.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.818+0000 7f249effd640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f248006be30 0x7f248006e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2490007fd0 tx=0x7f2490009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.818+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bf0007070 con 0x7f8bfc071f70 2024-06-13T11:37:23.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.819+0000 7f8bf8ff9640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8be806bf00 0x7f8be806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.819+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8bf00933e0 con 0x7f8bfc071f70 2024-06-13T11:37:23.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.819+0000 7f8bfb7fe640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8be806bf00 0x7f8be806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.820+0000 7f8bfb7fe640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8be806bf00 0x7f8be806e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc1414c0 tx=0x7f8bec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.821+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd9140d2500 con 0x7fd9140d3150 2024-06-13T11:37:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.822+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8bfc1521c0 con 0x7f8bfc071f70 2024-06-13T11:37:23.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.823+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2488058390 con 0x7f24a0072fa0 2024-06-13T11:37:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.823+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea88012b50 con 0x7fea981424b0 2024-06-13T11:37:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.824+0000 7fea94ff9640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea8406be60 0x7fea8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.824+0000 7fea97fff640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea8406be60 0x7fea8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.824+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea8808beb0 con 0x7fea981424b0 2024-06-13T11:37:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.825+0000 7fea97fff640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea8406be60 0x7fea8406e320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea90009fd0 tx=0x7fea90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.826+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb6280586a0 con 0x7fb62c053c70 2024-06-13T11:37:23.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.826+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e000fb20 con 0x7f91e8156fc0 2024-06-13T11:37:23.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.826+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e001a070 con 0x7f91e8156fc0 2024-06-13T11:37:23.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.826+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0015470 con 0x7f91e8156fc0 2024-06-13T11:37:23.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.827+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e8155da0 con 0x7f91e8156fc0 2024-06-13T11:37:23.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.827+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e8156360 con 0x7f91e8156fc0 2024-06-13T11:37:23.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.827+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fea88059ec0 con 0x7fea981424b0 2024-06-13T11:37:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.828+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e804ffb0 con 0x7f91e8156fc0 2024-06-13T11:37:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.829+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91e0015610 con 0x7f91e8156fc0 2024-06-13T11:37:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.830+0000 7f91d6ffd640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f91c806bf00 0x7f91c806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.830+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f91e008b500 con 0x7f91e8156fc0 2024-06-13T11:37:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.831+0000 7f91e659c640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f91c806bf00 0x7f91c806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.831+0000 7f91e659c640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f91c806bf00 0x7f91c806e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91dc033000 tx=0x7f91dc009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:23.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:23.835+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f91e0059500 con 0x7f91e8156fc0 2024-06-13T11:37:24.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.244+0000 7f589a72e640 1 -- 172.21.15.43:0/2839288758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5874005580 con 0x7f588c058130 2024-06-13T11:37:24.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.245+0000 7f5889ffb640 1 -- 172.21.15.43:0/2839288758 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58940f92c0 con 0x7f588c058130 2024-06-13T11:37:24.244 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-06-13T11:37:24.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.247+0000 7f7f97fff640 1 -- 172.21.15.43:0/3048545406 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7f980c4390 con 0x7f7f98148d10 2024-06-13T11:37:24.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 -- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f587806bf00 msgr2=0x7f587806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f7f8ffff640 1 -- 172.21.15.43:0/3048545406 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7f90079fa0 con 0x7f7f98148d10 2024-06-13T11:37:24.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f587806bf00 0x7f587806e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f588c012370 tx=0x7f5890008040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 -- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 msgr2=0x7f588c0e4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 0x7f588c0e4990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5894069ec0 tx=0x7f589406b250 comp rx=0 tx=0).stop 2024-06-13T11:37:24.248 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 -- 172.21.15.43:0/2839288758 shutdown_connections 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f587806bf00 0x7f587806e3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.248+0000 7f587f7fe640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f588c0e3420 0x7f588c0e0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.249+0000 7f587f7fe640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0e3040 0x7f588c1779b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.249+0000 7f587f7fe640 1 --2- 172.21.15.43:0/2839288758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f588c058130 0x7f588c0e4990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.249+0000 7f587f7fe640 1 -- 172.21.15.43:0/2839288758 >> 172.21.15.43:0/2839288758 conn(0x7f588c03aa40 msgr2=0x7f588c03e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.249+0000 7f587f7fe640 1 -- 172.21.15.43:0/2839288758 shutdown_connections 2024-06-13T11:37:24.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.249+0000 7f587f7fe640 1 -- 172.21.15.43:0/2839288758 wait complete. 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.251+0000 7f7f8d7fa640 1 -- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7f7c06bf00 msgr2=0x7f7f7c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.251+0000 7f7f8d7fa640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7f7c06bf00 0x7f7f7c06e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7f800018b0 tx=0x7f7f80009040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.251+0000 7f7f8d7fa640 1 -- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 msgr2=0x7f7f980c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.251+0000 7f7f8d7fa640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f980c6e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f90030000 tx=0x7f7f90004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 -- 172.21.15.43:0/3048545406 shutdown_connections 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f7f7c06bf00 0x7f7f7c06e3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7f98148d10 0x7f7f980c6e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98148930 0x7f7f980c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 --2- 172.21.15.43:0/3048545406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f980cf370 0x7f7f9815fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 -- 172.21.15.43:0/3048545406 >> 172.21.15.43:0/3048545406 conn(0x7f7f980b2810 msgr2=0x7f7f98070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 -- 172.21.15.43:0/3048545406 shutdown_connections 2024-06-13T11:37:24.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.252+0000 7f7f8d7fa640 1 -- 172.21.15.43:0/3048545406 wait complete. 2024-06-13T11:37:24.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.255+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd91404ffb0 con 0x7fd9140d3150 2024-06-13T11:37:24.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.256+0000 7fd8fb7fe640 1 -- 172.21.15.43:0/3064135523 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd90408e030 con 0x7fd9140d3150 2024-06-13T11:37:24.255 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-06-13T11:37:24.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.257+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8bdc005850 con 0x7f8bfc071f70 2024-06-13T11:37:24.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.257+0000 7f8bf8ff9640 1 -- 172.21.15.43:0/442940383 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8bf0061ac0 con 0x7f8bfc071f70 2024-06-13T11:37:24.256 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-06-13T11:37:24.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd90006be30 msgr2=0x7fd90006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7fd919664640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd90006be30 0x7fd90006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9141fbbf0 tx=0x7fd90c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8be806bf00 msgr2=0x7f8be806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7f8c01085640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8be806bf00 0x7f8be806e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc1414c0 tx=0x7f8bec009040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 msgr2=0x7f8bfc08b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 msgr2=0x7fd9140d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.260+0000 7fd919664640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 0x7fd9140d1f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd90400c480 tx=0x7fd90400c940 comp rx=0 tx=0).stop 2024-06-13T11:37:24.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 0x7f8bfc08b920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000c4d0 tx=0x7f8bf000c990 comp rx=0 tx=0).stop 2024-06-13T11:37:24.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 shutdown_connections 2024-06-13T11:37:24.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7fd919664640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd90006be30 0x7fd90006e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7fd919664640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd914165dd0 0x7fd914143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7fd919664640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd91414bf60 0x7fd91406d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7fd919664640 1 --2- 172.21.15.43:0/3064135523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9140d3150 0x7fd9140d1f00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 >> 172.21.15.43:0/3064135523 conn(0x7fd914067640 msgr2=0x7fd914070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 shutdown_connections 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8be806bf00 0x7f8be806e3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bfc15f390 0x7f8bfc159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bfc0ae6e0 0x7f8bfc1518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 --2- 172.21.15.43:0/442940383 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8bfc071f70 0x7f8bfc08b920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.261+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 >> 172.21.15.43:0/442940383 conn(0x7f8bfc0d0f20 msgr2=0x7f8bfc0d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.262+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 shutdown_connections 2024-06-13T11:37:24.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.262+0000 7fd919664640 1 -- 172.21.15.43:0/3064135523 wait complete. 2024-06-13T11:37:24.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.262+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 shutdown_connections 2024-06-13T11:37:24.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.262+0000 7f8c01085640 1 -- 172.21.15.43:0/442940383 wait complete. 2024-06-13T11:37:24.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.262+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb618005850 con 0x7fb62c053c70 2024-06-13T11:37:24.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.263+0000 7fb622ffd640 1 -- 172.21.15.43:0/489571446 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb62805c9a0 con 0x7fb62c053c70 2024-06-13T11:37:24.265 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-06-13T11:37:24.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.265+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fea98164380 con 0x7fea981424b0 2024-06-13T11:37:24.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.266+0000 7fea94ff9640 1 -- 172.21.15.43:0/2888609481 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea8805e1c0 con 0x7fea981424b0 2024-06-13T11:37:24.265 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:24.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f24a014baf0 con 0x7f24a0072fa0 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb61406be80 msgr2=0x7fb61406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb61406be80 0x7fb61406e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb62400a6d0 tx=0x7fb62402e000 comp rx=0 tx=0).stop 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c053c70 msgr2=0x7fb62c04ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c053c70 0x7fb62c04ce50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb62800d610 tx=0x7fb62800dad0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 shutdown_connections 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb61406be80 0x7fb61406e340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb62c0df220 0x7fb62c04d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb62c053c70 0x7fb62c04ce50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 --2- 172.21.15.43:0/489571446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62c033ef0 0x7fb62c0d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 >> 172.21.15.43:0/489571446 conn(0x7fb62c009fb0 msgr2=0x7fb62c0dfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-06-13T11:37:24.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.267+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 shutdown_connections 2024-06-13T11:37:24.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.268+0000 7fb63359e640 1 -- 172.21.15.43:0/489571446 wait complete. 2024-06-13T11:37:24.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.268+0000 7f24977fe640 1 -- 172.21.15.43:0/1937266417 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f248805c690 con 0x7f24a0072fa0 2024-06-13T11:37:24.269 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:24.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.269+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea8406be60 msgr2=0x7fea8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.269+0000 7fea9e310640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea8406be60 0x7fea8406e320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea90009fd0 tx=0x7fea90009040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.269+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea981424b0 msgr2=0x7fea98149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.269+0000 7fea9e310640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea981424b0 0x7fea98149980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea980b37c0 tx=0x7fea8800d9c0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.269+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 shutdown_connections 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea8406be60 0x7fea8406e320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea981424b0 0x7fea98149980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea98148e50 0x7fea9814bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 --2- 172.21.15.43:0/2888609481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea980ce6a0 0x7fea9813dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 >> 172.21.15.43:0/2888609481 conn(0x7fea98070810 msgr2=0x7fea980718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f91e8162e00 con 0x7f91e8156fc0 2024-06-13T11:37:24.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 shutdown_connections 2024-06-13T11:37:24.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7fea9e310640 1 -- 172.21.15.43:0/2888609481 wait complete. 2024-06-13T11:37:24.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.270+0000 7f91d6ffd640 1 -- 172.21.15.43:0/4283470827 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91e005d800 con 0x7f91e8156fc0 2024-06-13T11:37:24.271 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-06-13T11:37:24.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f248006be30 msgr2=0x7f248006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f248006be30 0x7f248006e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2490007fd0 tx=0x7f2490009040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0072fa0 msgr2=0x7f24a015fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0072fa0 0x7f24a015fae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f248800c3c0 tx=0x7f248800c880 comp rx=0 tx=0).stop 2024-06-13T11:37:24.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 shutdown_connections 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f248006be30 0x7f248006e2f0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2490007fd0 tx=0x7f2490009040 comp rx=0 tx=0).stop 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24a0148e40 0x7f24a006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24a0072fa0 0x7f24a015fae0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 --2- 172.21.15.43:0/1937266417 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f24a0072bc0 0x7f24a01f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.271+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 >> 172.21.15.43:0/1937266417 conn(0x7f24a00b14b0 msgr2=0x7f24a0145b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.272+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 shutdown_connections 2024-06-13T11:37:24.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.272+0000 7f24a556a640 1 -- 172.21.15.43:0/1937266417 wait complete. 2024-06-13T11:37:24.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f91c806bf00 msgr2=0x7f91c806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f91c806bf00 0x7f91c806e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91dc033000 tx=0x7f91dc009030 comp rx=0 tx=0).stop 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 msgr2=0x7f91e8152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 0x7f91e8152cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91e80d0fd0 tx=0x7f91e0007e20 comp rx=0 tx=0).stop 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 shutdown_connections 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f91c806bf00 0x7f91c806e3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91e8156fc0 0x7f91e8152cf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91e8156b60 0x7f91e8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 --2- 172.21.15.43:0/4283470827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91d00039f0 0x7f91e80d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:24.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 >> 172.21.15.43:0/4283470827 conn(0x7f91e8067640 msgr2=0x7f91e80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:24.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 shutdown_connections 2024-06-13T11:37:24.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:24.274+0000 7f91ecfa2640 1 -- 172.21.15.43:0/4283470827 wait complete. 2024-06-13T11:37:24.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-06-13T11:37:24.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-06-13T11:37:24.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-06-13T11:37:24.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2024-06-13T11:37:24.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2024-06-13T11:37:24.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2024-06-13T11:37:25.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-13T11:37:25.275 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-13T11:37:25.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-13T11:37:25.285 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-13T11:37:25.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-13T11:37:25.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-13T11:37:25.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-13T11:37:25.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-13T11:37:25.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.446+0000 7f8fbcfb7640 1 Processor -- start 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.447+0000 7f8fbcfb7640 1 -- start start 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.448+0000 7f8fbcfb7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.448+0000 7f8fbcfb7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb806dd10 con 0x7f8fb81431d0 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.448+0000 7f8fbcfb7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb8072030 con 0x7f8fb806d860 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.448+0000 7f8fbcfb7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb8072310 con 0x7f8fb806ed40 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.449+0000 7f8fb659c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8fb81431d0 0x7f8fb806e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52998/0 (socket says 172.21.15.43:52998) 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.449+0000 7f8fb659c640 1 -- 172.21.15.43:0/937789489 learned_addr learned my addr 172.21.15.43:0/937789489 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.449+0000 7f8fb5d9b640 1 --2- 172.21.15.43:0/937789489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.450+0000 7f8fb559a640 1 -- 172.21.15.43:0/937789489 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378726503 0 0) 0x7f8fb806dd10 con 0x7f8fb81431d0 2024-06-13T11:37:25.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.450+0000 7f8fb559a640 1 -- 172.21.15.43:0/937789489 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fa0003520 con 0x7f8fb81431d0 2024-06-13T11:37:25.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.450+0000 7f8fb5d9b640 1 -- 172.21.15.43:0/937789489 >> v1:172.21.15.53:6789/0 conn(0x7f8fb806d860 legacy=0x7f8fb815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.450+0000 7f8fb5d9b640 1 -- 172.21.15.43:0/937789489 >> v1:172.21.15.43:6789/0 conn(0x7f8fb81431d0 legacy=0x7f8fb806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.450+0000 7f8fb5d9b640 1 -- 172.21.15.43:0/937789489 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb80725f0 con 0x7f8fb806ed40 2024-06-13T11:37:25.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.452+0000 7f8fb5d9b640 1 --2- 172.21.15.43:0/937789489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8071a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000aed0 tx=0x7f8fb002c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2325445e3ac307e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.452+0000 7f8fb559a640 1 -- 172.21.15.43:0/937789489 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0039070 con 0x7f8fb806ed40 2024-06-13T11:37:25.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.452+0000 7f8fb559a640 1 -- 172.21.15.43:0/937789489 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb0034660 con 0x7f8fb806ed40 2024-06-13T11:37:25.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.453+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/937789489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 msgr2=0x7f8fb8071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.453+0000 7f8fbcfb7640 1 --2- 172.21.15.43:0/937789489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8071a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000aed0 tx=0x7f8fb002c8b0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.454+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/937789489 shutdown_connections 2024-06-13T11:37:25.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.454+0000 7f8fbcfb7640 1 --2- 172.21.15.43:0/937789489 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8071a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.454+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/937789489 >> 172.21.15.43:0/937789489 conn(0x7f8fb80671f0 msgr2=0x7f8fb8067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.454+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/937789489 shutdown_connections 2024-06-13T11:37:25.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.454+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/937789489 wait complete. 2024-06-13T11:37:25.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.456+0000 7f8fbcfb7640 1 Processor -- start 2024-06-13T11:37:25.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.457+0000 7f8fbcfb7640 1 -- start start 2024-06-13T11:37:25.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.458+0000 7f8fbcfb7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 0x7f8fb81e1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.458+0000 7f8fbcfb7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8203b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.458+0000 7f8fb659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 0x7f8fb81e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.458+0000 7f8fb659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 0x7f8fb81e1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47642/0 (socket says 172.21.15.43:47642) 2024-06-13T11:37:25.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.458+0000 7f8fb659c640 1 -- 172.21.15.43:0/2644315262 learned_addr learned my addr 172.21.15.43:0/2644315262 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.459+0000 7f8fbcfb7640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb81431d0 0x7f8fb8204bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.459+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb80b2810 con 0x7f8fb806d860 2024-06-13T11:37:25.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.459+0000 7f8fb5d9b640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8203b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.459+0000 7f8fb6d9d640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb81431d0 0x7f8fb8204bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.459+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb81435b0 con 0x7f8fb81431d0 2024-06-13T11:37:25.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.459+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb80b2990 con 0x7f8fb806ed40 2024-06-13T11:37:25.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb659c640 1 -- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 msgr2=0x7f8fb8203b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb659c640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8203b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb659c640 1 -- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb81431d0 msgr2=0x7f8fb8204bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb659c640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb81431d0 0x7f8fb8204bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb659c640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb8205130 con 0x7f8fb806d860 2024-06-13T11:37:25.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb659c640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 0x7f8fb81e1360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8001430 tx=0x7f8fa80018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.460+0000 7f8fb5d9b640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8203b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:25.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.461+0000 7f8fb6d9d640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb81431d0 0x7f8fb8204bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:25.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.461+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800f700 con 0x7f8fb806d860 2024-06-13T11:37:25.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.461+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb81e02c0 con 0x7f8fb806d860 2024-06-13T11:37:25.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.464+0000 7f8fbcfb7640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb81e0880 con 0x7f8fb806d860 2024-06-13T11:37:25.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.466+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa8015020 con 0x7f8fb806d860 2024-06-13T11:37:25.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.466+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800faa0 con 0x7f8fb806d860 2024-06-13T11:37:25.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.466+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fa800fd00 con 0x7f8fb806d860 2024-06-13T11:37:25.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.467+0000 7f8fa6ffd640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8f9806bf30 0x7f8f9806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.467+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8fa808ad10 con 0x7f8fb806d860 2024-06-13T11:37:25.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.469+0000 7f8fb5d9b640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8f9806bf30 0x7f8f9806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.469+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb80ce850 con 0x7f8fb806d860 2024-06-13T11:37:25.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.478+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8fa80be3e0 con 0x7f8fb806d860 2024-06-13T11:37:25.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.485+0000 7f8fb5d9b640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8f9806bf30 0x7f8f9806e3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0036000 tx=0x7f8fb000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.501+0000 7f3c1bfff640 1 Processor -- start 2024-06-13T11:37:25.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.501+0000 7f3c1bfff640 1 -- start start 2024-06-13T11:37:25.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.501+0000 7fd41a7f6640 1 Processor -- start 2024-06-13T11:37:25.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.502+0000 7fd41a7f6640 1 -- start start 2024-06-13T11:37:25.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.502+0000 7f5a20b9e640 1 Processor -- start 2024-06-13T11:37:25.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.502+0000 7f5a20b9e640 1 -- start start 2024-06-13T11:37:25.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3c1c15c240 0x7f3c1c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 0x7f3c1c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd41a7f6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c0e7600 0x7fd40c007670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd41a7f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd40c053c50 0x7fd40c03bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd41a7f6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40c0e79e0 con 0x7fd40c0589d0 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd41a7f6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd40c007bb0 con 0x7fd40c053c50 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd41a7f6640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c0065d0 con 0x7fd40c0e7600 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1bfff640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c15fbb0 con 0x7f3c1c15be60 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1bfff640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3c1c15fe90 con 0x7f3c1c15c240 2024-06-13T11:37:25.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c160170 con 0x7f3c1c06baa0 2024-06-13T11:37:25.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 0x7f3c1c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd280d0e640 1 Processor -- start 2024-06-13T11:37:25.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 0x7f3c1c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47726/0 (socket says 172.21.15.43:47726) 2024-06-13T11:37:25.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f3c1b7fe640 1 -- 172.21.15.43:0/388245322 learned_addr learned my addr 172.21.15.43:0/388245322 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7f7736885640 1 Processor -- start 2024-06-13T11:37:25.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd418ff3640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd40c0589d0 0x7fd40c053540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53000/0 (socket says 172.21.15.43:53000) 2024-06-13T11:37:25.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd418ff3640 1 -- 172.21.15.43:0/50529803 learned_addr learned my addr 172.21.15.43:0/50529803 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:25.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.503+0000 7fd419ff5640 1 --2- 172.21.15.43:0/50529803 >> v2:172.21.15.43:3300/0 conn(0x7fd40c053c50 0x7fd40c03bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f5a20b9e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5a1c0cf050 0x7f5a1c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f5a20b9e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c1518e0 con 0x7f5a1c151430 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f5a20b9e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c072300 con 0x7f5a1c06b390 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f5a20b9e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1c071260 con 0x7f5a1c0cf050 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f3c1b7fe640 1 -- 172.21.15.43:0/388245322 >> v2:172.21.15.53:3300/0 conn(0x7f3c1c15c240 msgr2=0x7f3c1c0b5bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f3c1b7fe640 1 --2- 172.21.15.43:0/388245322 >> v2:172.21.15.53:3300/0 conn(0x7f3c1c15c240 0x7f3c1c0b5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f3c1b7fe640 1 -- 172.21.15.43:0/388245322 >> v1:172.21.15.53:6789/0 conn(0x7f3c1c15be60 legacy=0x7f3c1c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f3c1b7fe640 1 -- 172.21.15.43:0/388245322 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c160450 con 0x7f3c1c06baa0 2024-06-13T11:37:25.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f7736885640 1 -- start start 2024-06-13T11:37:25.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7fd4197f4640 1 --2- 172.21.15.43:0/50529803 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c0e7600 0x7fd40c007670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f5a19d9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5a1c151430 0x7f5a1c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53006/0 (socket says 172.21.15.43:53006) 2024-06-13T11:37:25.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f5a19d9b640 1 -- 172.21.15.43:0/3786730542 learned_addr learned my addr 172.21.15.43:0/3786730542 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:25.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7fd280d0e640 1 -- start start 2024-06-13T11:37:25.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f3c1b7fe640 1 --2- 172.21.15.43:0/388245322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 0x7f3c1c0b60f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0ce6c0 tx=0x7f3c1402a6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c26d82763ed912 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f3c19ffb640 1 -- 172.21.15.43:0/388245322 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14036070 con 0x7f3c1c06baa0 2024-06-13T11:37:25.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f7736885640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77280f00b0 0x7f77280f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f3c19ffb640 1 -- 172.21.15.43:0/388245322 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c14031600 con 0x7f3c1c06baa0 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7fd40bfff640 1 -- 172.21.15.43:0/50529803 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026915397 0 0) 0x7fd40c0e79e0 con 0x7fd40c0589d0 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7fd40bfff640 1 -- 172.21.15.43:0/50529803 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd400003520 con 0x7fd40c0589d0 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7fd4197f4640 1 -- 172.21.15.43:0/50529803 >> v2:172.21.15.43:3300/0 conn(0x7fd40c053c50 msgr2=0x7fd40c03bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7fd4197f4640 1 --2- 172.21.15.43:0/50529803 >> v2:172.21.15.43:3300/0 conn(0x7fd40c053c50 0x7fd40c03bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7fd4197f4640 1 -- 172.21.15.43:0/50529803 >> v1:172.21.15.43:6789/0 conn(0x7fd40c0589d0 legacy=0x7fd40c053540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7fd4197f4640 1 -- 172.21.15.43:0/50529803 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c0068b0 con 0x7fd40c0e7600 2024-06-13T11:37:25.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f6eb71ee640 1 Processor -- start 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.504+0000 7f6eb71ee640 1 -- start start 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd280d0e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd27c06ee60 0x7fd27c0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd280d0e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c072c50 0x7fd27c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd280d0e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd27c0cc3e0 0x7fd27c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd280d0e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd27c072200 con 0x7fd27c0cc3e0 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd280d0e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd27c0727c0 con 0x7fd27c06ee60 2024-06-13T11:37:25.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd280d0e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd27c0c3fe0 con 0x7fd27c072c50 2024-06-13T11:37:25.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f7736885640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77280e7990 con 0x7f7728037fe0 2024-06-13T11:37:25.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f7736885640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77280570a0 con 0x7f772803c100 2024-06-13T11:37:25.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.505+0000 7f7736885640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f77280383c0 con 0x7f77280f00b0 2024-06-13T11:37:25.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb71ee640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb013dee0 0x7f6eb01413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb71ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6eb013e2c0 0x7f6eb015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb71ee640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb015b6c0 con 0x7f6eb015be60 2024-06-13T11:37:25.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb71ee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb015b9d0 con 0x7f6eb013e2c0 2024-06-13T11:37:25.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb71ee640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb015f1f0 con 0x7f6eb013dee0 2024-06-13T11:37:25.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd4197f4640 1 --2- 172.21.15.43:0/50529803 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c0e7600 0x7fd40c007670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4100097a0 tx=0x7fd41002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e9b47f96eb82dba server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f3c19ffb640 1 -- 172.21.15.43:0/388245322 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140319d0 con 0x7f3c1c06baa0 2024-06-13T11:37:25.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f7735883640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7728037fe0 0x7f7728058420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53012/0 (socket says 172.21.15.43:53012) 2024-06-13T11:37:25.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f7735883640 1 -- 172.21.15.43:0/3276878819 learned_addr learned my addr 172.21.15.43:0/3276878819 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:25.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd27b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd27c06ee60 0x7fd27c0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f7736084640 1 --2- 172.21.15.43:0/3276878819 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77280f00b0 0x7f77280f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb578b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6eb015be60 0x7f6eb013e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53014/0 (socket says 172.21.15.43:53014) 2024-06-13T11:37:25.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb578b640 1 -- 172.21.15.43:0/1353524650 learned_addr learned my addr 172.21.15.43:0/1353524650 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:25.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eaffff640 1 --2- 172.21.15.43:0/1353524650 >> v2:172.21.15.53:3300/0 conn(0x7f6eb013e2c0 0x7f6eb015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd27affd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c072c50 0x7fd27c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd27b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd27c06ee60 0x7fd27c0cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43340/0 (socket says 172.21.15.43:43340) 2024-06-13T11:37:25.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd27affd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c072c50 0x7fd27c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47744/0 (socket says 172.21.15.43:47744) 2024-06-13T11:37:25.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd27b7fe640 1 -- 172.21.15.43:0/2535000639 learned_addr learned my addr 172.21.15.43:0/2535000639 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd40bfff640 1 -- 172.21.15.43:0/50529803 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410037070 con 0x7fd40c0e7600 2024-06-13T11:37:25.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f3c1bfff640 1 -- 172.21.15.43:0/388245322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 msgr2=0x7f3c1c0b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/388245322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 0x7f3c1c0b60f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0ce6c0 tx=0x7f3c1402a6b0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7fd27bfff640 1 --2- 172.21.15.43:0/2535000639 >> v2:172.21.15.43:3300/0 conn(0x7fd27c0cc3e0 0x7fd27c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.506+0000 7f6eb4f8a640 1 --2- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb013dee0 0x7f6eb01413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd40bfff640 1 -- 172.21.15.43:0/50529803 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd410032440 con 0x7fd40c0e7600 2024-06-13T11:37:25.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd40bfff640 1 -- 172.21.15.43:0/50529803 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410032810 con 0x7fd40c0e7600 2024-06-13T11:37:25.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f3c1bfff640 1 -- 172.21.15.43:0/388245322 shutdown_connections 2024-06-13T11:37:25.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/388245322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c06baa0 0x7f3c1c0b60f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/388245322 >> v2:172.21.15.53:3300/0 conn(0x7f3c1c15c240 0x7f3c1c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f3c1bfff640 1 -- 172.21.15.43:0/388245322 >> 172.21.15.43:0/388245322 conn(0x7f3c1c0b3540 msgr2=0x7f3c1c0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd27b7fe640 1 -- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c072c50 msgr2=0x7fd27c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd27b7fe640 1 --2- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c072c50 0x7fd27c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd27b7fe640 1 -- 172.21.15.43:0/2535000639 >> v2:172.21.15.43:3300/0 conn(0x7fd27c0cc3e0 msgr2=0x7fd27c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd27b7fe640 1 --2- 172.21.15.43:0/2535000639 >> v2:172.21.15.43:3300/0 conn(0x7fd27c0cc3e0 0x7fd27c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7fd27b7fe640 1 -- 172.21.15.43:0/2535000639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c072450 con 0x7fd27c06ee60 2024-06-13T11:37:25.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167079298 0 0) 0x7f5a1c1518e0 con 0x7f5a1c151430 2024-06-13T11:37:25.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f42b8b90640 1 Processor -- start 2024-06-13T11:37:25.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f42b8b90640 1 -- start start 2024-06-13T11:37:25.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04003520 con 0x7f5a1c151430 2024-06-13T11:37:25.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f7736084640 1 -- 172.21.15.43:0/3276878819 >> v1:172.21.15.53:6789/0 conn(0x7f772803c100 legacy=0x7f772803c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T11:37:25.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f7736084640 1 -- 172.21.15.43:0/3276878819 >> v1:172.21.15.43:6789/0 conn(0x7f7728037fe0 legacy=0x7f7728058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061859784 0 0) 0x7f5a1c072300 con 0x7f5a1c06b390 2024-06-13T11:37:25.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f7736084640 1 -- 172.21.15.43:0/3276878819 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7728057380 con 0x7f77280f00b0 2024-06-13T11:37:25.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a1c1518e0 con 0x7f5a1c06b390 2024-06-13T11:37:25.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f6eaf7fe640 1 -- 172.21.15.43:0/1353524650 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298454211 0 0) 0x7f6ea8001490 con 0x7f6eb015be60 2024-06-13T11:37:25.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f6eaf7fe640 1 -- 172.21.15.43:0/1353524650 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e9c003520 con 0x7f6eb015be60 2024-06-13T11:37:25.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f6eaffff640 1 -- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb013dee0 msgr2=0x7f6eb01413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:25.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f6eaffff640 1 --2- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb013dee0 0x7f6eb01413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f6eaffff640 1 -- 172.21.15.43:0/1353524650 >> v1:172.21.15.43:6789/0 conn(0x7f6eb015be60 legacy=0x7f6eb013e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f6eaffff640 1 -- 172.21.15.43:0/1353524650 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb015f490 con 0x7f6eb013e2c0 2024-06-13T11:37:25.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 -- 172.21.15.43:0/50529803 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c0e7600 msgr2=0x7fd40c007670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 --2- 172.21.15.43:0/50529803 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c0e7600 0x7fd40c007670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4100097a0 tx=0x7fd41002a180 comp rx=0 tx=0).stop 2024-06-13T11:37:25.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f3c1bfff640 1 -- 172.21.15.43:0/388245322 shutdown_connections 2024-06-13T11:37:25.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.507+0000 7f5a1ad9d640 1 --2- 172.21.15.43:0/3786730542 >> v2:172.21.15.43:3300/0 conn(0x7f5a1c0cf050 0x7f5a1c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f5a1ad9d640 1 -- 172.21.15.43:0/3786730542 >> v1:172.21.15.53:6789/0 conn(0x7f5a1c06b390 legacy=0x7f5a1c070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f5a1ad9d640 1 -- 172.21.15.43:0/3786730542 >> v1:172.21.15.43:6789/0 conn(0x7f5a1c151430 legacy=0x7f5a1c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f5a1ad9d640 1 -- 172.21.15.43:0/3786730542 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c071540 con 0x7f5a1c0cf050 2024-06-13T11:37:25.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f3c1bfff640 1 -- 172.21.15.43:0/388245322 wait complete. 2024-06-13T11:37:25.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 -- 172.21.15.43:0/50529803 shutdown_connections 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 --2- 172.21.15.43:0/50529803 >> v2:172.21.15.43:3300/0 conn(0x7fd40c053c50 0x7fd40c03bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 --2- 172.21.15.43:0/50529803 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c0e7600 0x7fd40c007670 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4100097a0 tx=0x7fd41002a180 comp rx=0 tx=0).stop 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 -- 172.21.15.43:0/50529803 >> 172.21.15.43:0/50529803 conn(0x7fd40c058ef0 msgr2=0x7fd40c059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f7736084640 1 --2- 172.21.15.43:0/3276878819 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77280f00b0 0x7f77280f24a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f77200097d0 tx=0x7f772002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20263ee95d400ea0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f7734881640 1 -- 172.21.15.43:0/3276878819 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720037070 con 0x7f77280f00b0 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f7734881640 1 -- 172.21.15.43:0/3276878819 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720032440 con 0x7f77280f00b0 2024-06-13T11:37:25.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f7734881640 1 -- 172.21.15.43:0/3276878819 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720032810 con 0x7f77280f00b0 2024-06-13T11:37:25.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 -- 172.21.15.43:0/50529803 shutdown_connections 2024-06-13T11:37:25.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd41a7f6640 1 -- 172.21.15.43:0/50529803 wait complete. 2024-06-13T11:37:25.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7fd27b7fe640 1 --2- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c06ee60 0x7fd27c0cf9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd27c068f20 tx=0x7fd26c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968a494f477f4571 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f6eaffff640 1 --2- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013e2c0 0x7f6eb015ecb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00097a0 tx=0x7f6ea002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b133916a1c540998 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7fd27a7fc640 1 -- 172.21.15.43:0/2535000639 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c037070 con 0x7fd27c06ee60 2024-06-13T11:37:25.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7fd27a7fc640 1 -- 172.21.15.43:0/2535000639 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26c032440 con 0x7fd27c06ee60 2024-06-13T11:37:25.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7fd27a7fc640 1 -- 172.21.15.43:0/2535000639 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c032810 con 0x7fd27c06ee60 2024-06-13T11:37:25.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f7736885640 1 -- 172.21.15.43:0/3276878819 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77280f00b0 msgr2=0x7f77280f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f7736885640 1 --2- 172.21.15.43:0/3276878819 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77280f00b0 0x7f77280f24a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f77200097d0 tx=0x7f772002a1c0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f5a1ad9d640 1 --2- 172.21.15.43:0/3786730542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c15bb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009d90 tx=0x7f5a1402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c9d37bc991fb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f6eaf7fe640 1 -- 172.21.15.43:0/1353524650 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0037070 con 0x7f6eb013e2c0 2024-06-13T11:37:25.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f6eaf7fe640 1 -- 172.21.15.43:0/1353524650 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea002ae40 con 0x7f6eb013e2c0 2024-06-13T11:37:25.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.509+0000 7f6eaf7fe640 1 -- 172.21.15.43:0/1353524650 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0032660 con 0x7f6eb013e2c0 2024-06-13T11:37:25.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 -- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c06ee60 msgr2=0x7fd27c0cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f3c1bfff640 1 Processor -- start 2024-06-13T11:37:25.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c06ee60 0x7fd27c0cf9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd27c068f20 tx=0x7fd26c02a270 comp rx=0 tx=0).stop 2024-06-13T11:37:25.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 -- 172.21.15.43:0/2535000639 shutdown_connections 2024-06-13T11:37:25.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2535000639 >> v2:172.21.15.43:3300/0 conn(0x7fd27c0cc3e0 0x7fd27c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007740 con 0x7f5a1c0cf050 2024-06-13T11:37:25.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c072c50 0x7fd27c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2535000639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c06ee60 0x7fd27c0cf9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd280d0e640 1 -- 172.21.15.43:0/2535000639 >> 172.21.15.43:0/2535000639 conn(0x7fd27c067610 msgr2=0x7fd27c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a140078e0 con 0x7f5a1c0cf050 2024-06-13T11:37:25.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f5a1959a640 1 -- 172.21.15.43:0/3786730542 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007cb0 con 0x7f5a1c0cf050 2024-06-13T11:37:25.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f3c1bfff640 1 -- start start 2024-06-13T11:37:25.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f7736885640 1 -- 172.21.15.43:0/3276878819 shutdown_connections 2024-06-13T11:37:25.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f7736885640 1 --2- 172.21.15.43:0/3276878819 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f77280f00b0 0x7f77280f24a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f7736885640 1 -- 172.21.15.43:0/3276878819 >> 172.21.15.43:0/3276878819 conn(0x7f7728058ef0 msgr2=0x7f7728059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f7736885640 1 -- 172.21.15.43:0/3276878819 shutdown_connections 2024-06-13T11:37:25.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f42b8b90640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b40b0ef0 0x7f42b40cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.508+0000 7f42b8b90640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42b40ce3c0 0x7f42b41666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b8b90640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b40b12d0 con 0x7f42b4166c00 2024-06-13T11:37:25.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b8b90640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f42b40cc830 con 0x7f42b40ce3c0 2024-06-13T11:37:25.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd41a7f6640 1 Processor -- start 2024-06-13T11:37:25.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b8b90640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f42b40cca80 con 0x7f42b40b0ef0 2024-06-13T11:37:25.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b2d9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f42b4166c00 0x7f42b4070810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53028/0 (socket says 172.21.15.43:53028) 2024-06-13T11:37:25.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b2d9d640 1 -- 172.21.15.43:0/4281597714 learned_addr learned my addr 172.21.15.43:0/4281597714 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:25.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b259c640 1 --2- 172.21.15.43:0/4281597714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b40b0ef0 0x7f42b40cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f7736885640 1 -- 172.21.15.43:0/3276878819 wait complete. 2024-06-13T11:37:25.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7fd41a7f6640 1 -- start start 2024-06-13T11:37:25.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f42b1d9b640 1 --2- 172.21.15.43:0/4281597714 >> v2:172.21.15.43:3300/0 conn(0x7f42b40ce3c0 0x7f42b41666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 -- 172.21.15.43:0/3786730542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c0cf050 msgr2=0x7f5a1c15bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/3786730542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c15bb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009d90 tx=0x7f5a1402a6a0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 -- 172.21.15.43:0/3786730542 shutdown_connections 2024-06-13T11:37:25.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/3786730542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c15bb60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 -- 172.21.15.43:0/3786730542 >> 172.21.15.43:0/3786730542 conn(0x7f5a1c0b14b0 msgr2=0x7f5a1c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f42b259c640 1 -- 172.21.15.43:0/4281597714 >> v2:172.21.15.43:3300/0 conn(0x7f42b40ce3c0 msgr2=0x7f42b41666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:25.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 -- 172.21.15.43:0/3786730542 shutdown_connections 2024-06-13T11:37:25.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f42b259c640 1 --2- 172.21.15.43:0/4281597714 >> v2:172.21.15.43:3300/0 conn(0x7f42b40ce3c0 0x7f42b41666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f42b259c640 1 -- 172.21.15.43:0/4281597714 >> v1:172.21.15.43:6789/0 conn(0x7f42b4166c00 legacy=0x7f42b4070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f42b259c640 1 -- 172.21.15.43:0/4281597714 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b40ccd60 con 0x7f42b40b0ef0 2024-06-13T11:37:25.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f42b1d9b640 1 --2- 172.21.15.43:0/4281597714 >> v2:172.21.15.43:3300/0 conn(0x7f42b40ce3c0 0x7f42b41666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:25.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f6eb71ee640 1 -- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013e2c0 msgr2=0x7f6eb015ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.510+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013e2c0 0x7f6eb015ecb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00097a0 tx=0x7f6ea002a130 comp rx=0 tx=0).stop 2024-06-13T11:37:25.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f5a20b9e640 1 -- 172.21.15.43:0/3786730542 wait complete. 2024-06-13T11:37:25.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.511+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 0x7f3c1c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd280d0e640 1 -- 172.21.15.43:0/2535000639 shutdown_connections 2024-06-13T11:37:25.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd280d0e640 1 -- 172.21.15.43:0/2535000639 wait complete. 2024-06-13T11:37:25.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c1c15be60 0x7f3c1c144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c154090 0x7f3c1c1459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd41a7f6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c053c50 0x7fd40c0dd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f6eb71ee640 1 -- 172.21.15.43:0/1353524650 shutdown_connections 2024-06-13T11:37:25.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013e2c0 0x7f6eb015ecb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/1353524650 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb013dee0 0x7f6eb01413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f6eb71ee640 1 -- 172.21.15.43:0/1353524650 >> 172.21.15.43:0/1353524650 conn(0x7f6eb00671f0 msgr2=0x7f6eb0067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd41a7f6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 0x7fd40c00d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 0x7f3c1c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 0x7f3c1c0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:43366/0 (socket says 172.21.15.43:43366) 2024-06-13T11:37:25.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c1c15be60 0x7f3c1c144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c1c15be60 0x7f3c1c144b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47688/0 (socket says 172.21.15.43:47688) 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd4197f4640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c053c50 0x7fd40c0dd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd4197f4640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c053c50 0x7fd40c0dd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47778/0 (socket says 172.21.15.43:47778) 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd418ff3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 0x7fd40c00d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd418ff3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 0x7fd40c00d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47700/0 (socket says 172.21.15.43:47700) 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd41a7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd40c0e1f60 0x7fd40c0dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd4197f4640 1 -- 172.21.15.43:0/1069000288 learned_addr learned my addr 172.21.15.43:0/1069000288 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f7736885640 1 Processor -- start 2024-06-13T11:37:25.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c0b6630 con 0x7f3c1c15be60 2024-06-13T11:37:25.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c0ce9d0 con 0x7f3c1c06baa0 2024-06-13T11:37:25.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c0b67b0 con 0x7f3c1c154090 2024-06-13T11:37:25.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f3c1affd640 1 -- 172.21.15.43:0/389546593 learned_addr learned my addr 172.21.15.43:0/389546593 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f42b259c640 1 --2- 172.21.15.43:0/4281597714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b40b0ef0 0x7f42b40cde80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42a80097a0 tx=0x7f42a802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71c378f2e9670c2e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c1affd640 1 -- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c154090 msgr2=0x7f3c1c1459b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-13T11:37:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c1affd640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c154090 0x7f3c1c1459b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c1affd640 1 -- 172.21.15.43:0/389546593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c1c15be60 msgr2=0x7f3c1c144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c1affd640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c1c15be60 0x7f3c1c144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c1affd640 1 -- 172.21.15.43:0/389546593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c154520 con 0x7f3c1c06baa0 2024-06-13T11:37:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7f7736885640 1 -- start start 2024-06-13T11:37:25.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f42b159a640 1 -- 172.21.15.43:0/4281597714 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8037070 con 0x7f42b40b0ef0 2024-06-13T11:37:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f42b159a640 1 -- 172.21.15.43:0/4281597714 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a802ae50 con 0x7f42b40b0ef0 2024-06-13T11:37:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f42b159a640 1 -- 172.21.15.43:0/4281597714 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8032660 con 0x7f42b40b0ef0 2024-06-13T11:37:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c1affd640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 0x7f3c1c0b2a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c460 tx=0x7f3c0c00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f5a20b9e640 1 Processor -- start 2024-06-13T11:37:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c016020 con 0x7f3c1c06baa0 2024-06-13T11:37:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0c012870 con 0x7f3c1c06baa0 2024-06-13T11:37:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c012c60 con 0x7f3c1c06baa0 2024-06-13T11:37:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7736885640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 0x7f77280e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c0b26d0 con 0x7f3c1c06baa0 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd41a7f6640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c007150 con 0x7fd40c0589d0 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd41a7f6640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c006e70 con 0x7fd40c0e1f60 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd41a7f6640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c0061f0 con 0x7fd40c053c50 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.512+0000 7fd419ff5640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd40c0e1f60 0x7fd40c0dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7fd418ff3640 1 -- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c053c50 msgr2=0x7fd40c0dd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7fd418ff3640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c053c50 0x7fd40c0dd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7fd418ff3640 1 -- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd40c0e1f60 msgr2=0x7fd40c0dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7fd418ff3640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd40c0e1f60 0x7fd40c0dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7fd418ff3640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c0e2490 con 0x7fd40c0589d0 2024-06-13T11:37:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7fd418ff3640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 0x7fd40c00d680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd414064ec0 tx=0x7fd4140687b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c153890 con 0x7f3c1c06baa0 2024-06-13T11:37:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7fd419ff5640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd40c0e1f60 0x7fd40c0dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414075550 con 0x7fd40c0589d0 2024-06-13T11:37:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f6eb71ee640 1 -- 172.21.15.43:0/1353524650 shutdown_connections 2024-06-13T11:37:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7736885640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f772803c100 0x7f77280e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f42b8b90640 1 -- 172.21.15.43:0/4281597714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b40b0ef0 msgr2=0x7f42b40cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f42b8b90640 1 --2- 172.21.15.43:0/4281597714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b40b0ef0 0x7f42b40cde80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42a80097a0 tx=0x7f42a802a100 comp rx=0 tx=0).stop 2024-06-13T11:37:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7fd41a7f6640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c0e2770 con 0x7fd40c0589d0 2024-06-13T11:37:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7736885640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77280f00b0 0x7f77280e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f6eb71ee640 1 -- 172.21.15.43:0/1353524650 wait complete. 2024-06-13T11:37:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7736885640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7728057c20 con 0x7f772803c100 2024-06-13T11:37:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7736885640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f77280579c0 con 0x7f77280f00b0 2024-06-13T11:37:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7736885640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7728057f00 con 0x7f7728037fe0 2024-06-13T11:37:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7735883640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 0x7f77280e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7735883640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 0x7f77280e69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47804/0 (socket says 172.21.15.43:47804) 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7735883640 1 -- 172.21.15.43:0/3583118752 learned_addr learned my addr 172.21.15.43:0/3583118752 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f42b8b90640 1 -- 172.21.15.43:0/4281597714 shutdown_connections 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f42b8b90640 1 --2- 172.21.15.43:0/4281597714 >> v2:172.21.15.43:3300/0 conn(0x7f42b40ce3c0 0x7f42b41666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f42b8b90640 1 --2- 172.21.15.43:0/4281597714 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b40b0ef0 0x7f42b40cde80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f42b8b90640 1 -- 172.21.15.43:0/4281597714 >> 172.21.15.43:0/4281597714 conn(0x7f42b4067640 msgr2=0x7f42b40b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7f42b8b90640 1 -- 172.21.15.43:0/4281597714 shutdown_connections 2024-06-13T11:37:25.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7f42b8b90640 1 -- 172.21.15.43:0/4281597714 wait complete. 2024-06-13T11:37:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7fd280d0e640 1 Processor -- start 2024-06-13T11:37:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7fd280d0e640 1 -- start start 2024-06-13T11:37:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd280d0e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c06ee60 0x7fd27c1f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd280d0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 0x7fd27c1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd27affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 0x7fd27c1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.513+0000 7f5a20b9e640 1 -- start start 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a20b9e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 0x7f5a1c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a20b9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd27affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 0x7fd27c1f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47722/0 (socket says 172.21.15.43:47722) 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd27affd640 1 -- 172.21.15.43:0/2281869276 learned_addr learned my addr 172.21.15.43:0/2281869276 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c0cc3e0 0x7fd27c138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c0cdd80 con 0x7fd27c072c50 2024-06-13T11:37:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c0cdc00 con 0x7fd27c0cc3e0 2024-06-13T11:37:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.515+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fd27c0cdf00 con 0x7fd27c06ee60 2024-06-13T11:37:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a20b9e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5a1c151430 0x7f5a1c14f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27bfff640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c0cc3e0 0x7fd27c138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f6eb71ee640 1 Processor -- start 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27b7fe640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c06ee60 0x7fd27c1f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a20b9e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c071de0 con 0x7f5a1c06b390 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a20b9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c071b00 con 0x7f5a1c0cf050 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a20b9e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1c070f20 con 0x7f5a1c151430 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a1a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 0x7f5a1c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a1a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 0x7f5a1c1415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47724/0 (socket says 172.21.15.43:47724) 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f5a1a59c640 1 -- 172.21.15.43:0/2071131042 learned_addr learned my addr 172.21.15.43:0/2071131042 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc005290 con 0x7f3c1c06baa0 2024-06-13T11:37:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7735883640 1 -- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77280f00b0 msgr2=0x7f77280e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7735883640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77280f00b0 0x7f77280e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.514+0000 7f7735883640 1 -- 172.21.15.43:0/3583118752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f772803c100 msgr2=0x7f77280e19f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:37:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f7735082640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f772803c100 0x7f77280e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f7735883640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f772803c100 0x7f77280e19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f7735883640 1 -- 172.21.15.43:0/3583118752 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772803aae0 con 0x7f7728037fe0 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27affd640 1 -- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c06ee60 msgr2=0x7fd27c1f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27affd640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c06ee60 0x7fd27c1f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27affd640 1 -- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c0cc3e0 msgr2=0x7fd27c138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27affd640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c0cc3e0 0x7fd27c138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7fd27affd640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c138eb0 con 0x7fd27c072c50 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f42b8b90640 1 Processor -- start 2024-06-13T11:37:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a19d9b640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.516+0000 7f6eb71ee640 1 -- start start 2024-06-13T11:37:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1ad9d640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5a1c151430 0x7f5a1c14f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7fd41a7f6640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c0e2d30 con 0x7fd40c0589d0 2024-06-13T11:37:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c0c019020 con 0x7f3c1c06baa0 2024-06-13T11:37:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f7735883640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 0x7f77280e69f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c4d0 tx=0x7f772c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1a59c640 1 -- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5a1c151430 msgr2=0x7f5a1c14f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1a59c640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5a1c151430 0x7f5a1c14f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1a59c640 1 -- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a1c0cf050 msgr2=0x7f5a1c140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1a59c640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1a59c640 1 -- 172.21.15.43:0/2071131042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c141fa0 con 0x7f5a1c06b390 2024-06-13T11:37:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1ad9d640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5a1c151430 0x7f5a1c14f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f5a1a59c640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 0x7f5a1c1415a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00c3f0 tx=0x7f5a0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7f42b8b90640 1 -- start start 2024-06-13T11:37:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.517+0000 7fd27affd640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 0x7fd27c1f5ff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd26400e890 tx=0x7fd26400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f3c037fe640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3c0806bf00 0x7f3c0806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264017070 con 0x7fd27c072c50 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb71ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013dee0 0x7f6eb0153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb71ee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb015be60 0x7f6eb0072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb71ee640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 0x7f6eb0137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb71ee640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb013eec0 con 0x7f6eb015be60 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb71ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb015fa50 con 0x7f6eb013dee0 2024-06-13T11:37:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb71ee640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb013f040 con 0x7f6eb0137750 2024-06-13T11:37:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3c0c08add0 con 0x7f3c1c06baa0 2024-06-13T11:37:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f3c1a7fc640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3c0806bf00 0x7f3c0806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb578b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 0x7f6eb0137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c017070 con 0x7f7728037fe0 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb578b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 0x7f6eb0137c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47830/0 (socket says 172.21.15.43:47830) 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb578b640 1 -- 172.21.15.43:0/3615707643 learned_addr learned my addr 172.21.15.43:0/3615707643 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f6eb4f8a640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013dee0 0x7f6eb0153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c005ce0 con 0x7f7728037fe0 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c007270 con 0x7f7728037fe0 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772803adc0 con 0x7f7728037fe0 2024-06-13T11:37:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77280e5f30 con 0x7f7728037fe0 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f42b8b90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b40b0ef0 0x7f42b4146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f42b8b90640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b40ce3c0 0x7f42b4149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f42b8b90640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b4166c00 0x7f42b414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f42b8b90640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4167050 con 0x7f42b40ce3c0 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f42b8b90640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42b40cd320 con 0x7f42b40b0ef0 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f42b8b90640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f42b41671d0 con 0x7f42b4166c00 2024-06-13T11:37:25.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4140756f0 con 0x7fd40c0589d0 2024-06-13T11:37:25.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27c14f3b0 con 0x7fd27c072c50 2024-06-13T11:37:25.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27c14f970 con 0x7fd27c072c50 2024-06-13T11:37:25.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eb578b640 1 -- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013dee0 msgr2=0x7f6eb0153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eb578b640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013dee0 0x7f6eb0153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eb578b640 1 -- 172.21.15.43:0/3615707643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb015be60 msgr2=0x7f6eb0072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eaffff640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb015be60 0x7f6eb0072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eb578b640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb015be60 0x7f6eb0072c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eb578b640 1 -- 172.21.15.43:0/3615707643 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0071bd0 con 0x7f6eb0137750 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26400c940 con 0x7fd27c072c50 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f42b2d9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b4166c00 0x7f42b414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f42b1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b40ce3c0 0x7f42b4149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f42b2d9d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b4166c00 0x7f42b414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:47838/0 (socket says 172.21.15.43:47838) 2024-06-13T11:37:25.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f42b2d9d640 1 -- 172.21.15.43:0/1996454910 learned_addr learned my addr 172.21.15.43:0/1996454910 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:25.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eaffff640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb015be60 0x7f6eb0072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:25.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c017070 con 0x7f5a1c06b390 2024-06-13T11:37:25.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.518+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c142530 con 0x7f5a1c06b390 2024-06-13T11:37:25.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c142af0 con 0x7f5a1c06b390 2024-06-13T11:37:25.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0052d0 con 0x7f5a1c06b390 2024-06-13T11:37:25.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26400cd10 con 0x7fd27c072c50 2024-06-13T11:37:25.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6eb578b640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 0x7f6eb0137c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c760 tx=0x7f6ea800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c021060 con 0x7f5a1c06b390 2024-06-13T11:37:25.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f42b259c640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b40b0ef0 0x7f42b4146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414070a50 con 0x7fd40c0589d0 2024-06-13T11:37:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40c005710 con 0x7fd40c0589d0 2024-06-13T11:37:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.519+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8018070 con 0x7f6eb0137750 2024-06-13T11:37:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea800a5e0 con 0x7f6eb0137750 2024-06-13T11:37:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea800a9d0 con 0x7f6eb0137750 2024-06-13T11:37:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f3c1a7fc640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3c0806bf00 0x7f3c0806e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c15f860 tx=0x7f3c10009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd260005290 con 0x7fd27c072c50 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42b1d9b640 1 -- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b4166c00 msgr2=0x7f42b414a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42b1d9b640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b4166c00 0x7f42b414a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42b1d9b640 1 -- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b40b0ef0 msgr2=0x7f42b4146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42b1d9b640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b40b0ef0 0x7f42b4146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42b1d9b640 1 -- 172.21.15.43:0/1996454910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b4161d00 con 0x7f42b40ce3c0 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42b1d9b640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b40ce3c0 0x7f42b4149ff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42a400e930 tx=0x7f42a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.520+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4017070 con 0x7f42b40ce3c0 2024-06-13T11:37:25.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.521+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd414070c30 con 0x7fd40c0589d0 2024-06-13T11:37:25.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a00005290 con 0x7f5a1c06b390 2024-06-13T11:37:25.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7fd409ffb640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd3f806bf60 0x7fd3f806e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd41411b060 con 0x7fd40c0589d0 2024-06-13T11:37:25.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a0c01a070 con 0x7f5a1c06b390 2024-06-13T11:37:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.521+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b4161fe0 con 0x7f42b40ce3c0 2024-06-13T11:37:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.521+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b4160fd0 con 0x7f42b40ce3c0 2024-06-13T11:37:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7718005290 con 0x7f7728037fe0 2024-06-13T11:37:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3c0c08e030 con 0x7f3c1c06baa0 2024-06-13T11:37:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7fd4197f4640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd3f806bf60 0x7fd3f806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb0071eb0 con 0x7f6eb0137750 2024-06-13T11:37:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb0072470 con 0x7f6eb0137750 2024-06-13T11:37:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f5a0affd640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f59fc06be30 0x7f59fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b404ffb0 con 0x7f42b40ce3c0 2024-06-13T11:37:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.522+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd26401a070 con 0x7fd27c072c50 2024-06-13T11:37:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7fd273fff640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd25c06be30 0x7fd25c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd26408b8b0 con 0x7fd27c072c50 2024-06-13T11:37:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f5a19d9b640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f59fc06be30 0x7f59fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5a0c08a530 con 0x7f5a1c06b390 2024-06-13T11:37:25.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7fd4197f4640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd3f806bf60 0x7fd3f806e420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd410000c00 tx=0x7fd41002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7fd27b7fe640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd25c06be30 0x7fd25c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f772c01a070 con 0x7f7728037fe0 2024-06-13T11:37:25.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.523+0000 7f5a19d9b640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f59fc06be30 0x7f59fc06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c141550 tx=0x7f5a10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.524+0000 7fd27b7fe640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd25c06be30 0x7fd25c06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd26c034000 tx=0x7fd26c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.524+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb004ffb0 con 0x7f6eb0137750 2024-06-13T11:37:25.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.524+0000 7f77267fc640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f771406bf30 0x7f771406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.524+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f772c08a360 con 0x7f7728037fe0 2024-06-13T11:37:25.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.524+0000 7f7735082640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f771406bf30 0x7f771406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.525+0000 7f7735082640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f771406bf30 0x7f771406e3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f773006ac20 tx=0x7f773007ad50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.527+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a400ca00 con 0x7f42b40ce3c0 2024-06-13T11:37:25.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.527+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd4140a1030 con 0x7fd40c0589d0 2024-06-13T11:37:25.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.527+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f772c0583f0 con 0x7f7728037fe0 2024-06-13T11:37:25.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.528+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4021060 con 0x7f42b40ce3c0 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.530+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ea801b070 con 0x7f6eb0137750 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.531+0000 7f6ead7fa640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f6e9006bf30 0x7f6e9006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.531+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6ea808ad00 con 0x7f6eb0137750 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.531+0000 7f6eb4f8a640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f6e9006bf30 0x7f6e9006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.531+0000 7f6eb4f8a640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f6e9006bf30 0x7f6e9006e3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00cfb90 tx=0x7f6e98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.532+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6ea8022020 con 0x7f6eb0137750 2024-06-13T11:37:25.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.536+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd2640598b0 con 0x7fd27c072c50 2024-06-13T11:37:25.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.545+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5a0c001080 con 0x7f5a1c06b390 2024-06-13T11:37:25.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.547+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42a401a070 con 0x7f42b40ce3c0 2024-06-13T11:37:25.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.548+0000 7f42a2ffd640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:25.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.548+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42a408b760 con 0x7f42b40ce3c0 2024-06-13T11:37:25.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.553+0000 7f42b259c640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:25.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.555+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f42a4059820 con 0x7f42b40ce3c0 2024-06-13T11:37:25.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.555+0000 7f42b259c640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f429406be30 0x7f429406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42a8034000 tx=0x7f42a802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:25.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.902+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8fb80ce570 con 0x7f8fb806d860 2024-06-13T11:37:25.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.903+0000 7f8fa6ffd640 1 -- 172.21.15.43:0/2644315262 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fb8205130 con 0x7f8fb806d860 2024-06-13T11:37:25.905 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:25.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.906+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8f9806bf30 msgr2=0x7f8f9806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.906+0000 7f8fa4ff9640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8f9806bf30 0x7f8f9806e3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0036000 tx=0x7f8fb000a000 comp rx=0 tx=0).stop 2024-06-13T11:37:25.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.906+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 msgr2=0x7f8fb81e1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.906+0000 7f8fa4ff9640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 0x7f8fb81e1360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8001430 tx=0x7f8fa80018f0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 shutdown_connections 2024-06-13T11:37:25.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8f9806bf30 0x7f8f9806e3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb81431d0 0x7f8fb8204bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8fb806ed40 0x7f8fb8203b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 --2- 172.21.15.43:0/2644315262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb806d860 0x7f8fb81e1360 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 >> 172.21.15.43:0/2644315262 conn(0x7f8fb80671f0 msgr2=0x7f8fb80cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 shutdown_connections 2024-06-13T11:37:25.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.907+0000 7f8fa4ff9640 1 -- 172.21.15.43:0/2644315262 wait complete. 2024-06-13T11:37:25.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-06-13T11:37:25.924 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.939+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3bfc005580 con 0x7f3c1c06baa0 2024-06-13T11:37:25.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.940+0000 7f3c037fe640 1 -- 172.21.15.43:0/389546593 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c0c020030 con 0x7f3c1c06baa0 2024-06-13T11:37:25.939 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3c0806bf00 msgr2=0x7f3c0806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3c0806bf00 0x7f3c0806e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c15f860 tx=0x7f3c10009060 comp rx=0 tx=0).stop 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 msgr2=0x7f3c1c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 0x7f3c1c0b2a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c460 tx=0x7f3c0c00c920 comp rx=0 tx=0).stop 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 shutdown_connections 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3c0806bf00 0x7f3c0806e3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c1c154090 0x7f3c1c1459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c1c15be60 0x7f3c1c144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 --2- 172.21.15.43:0/389546593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c1c06baa0 0x7f3c1c0b2a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 >> 172.21.15.43:0/389546593 conn(0x7f3c1c0b3540 msgr2=0x7f3c1c1493a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.943+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 shutdown_connections 2024-06-13T11:37:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.944+0000 7f3c1bfff640 1 -- 172.21.15.43:0/389546593 wait complete. 2024-06-13T11:37:25.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.947+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5a00005580 con 0x7f5a1c06b390 2024-06-13T11:37:25.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.948+0000 7f5a0affd640 1 -- 172.21.15.43:0/2071131042 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a0c0583a0 con 0x7f5a1c06b390 2024-06-13T11:37:25.947 INFO:teuthology.orchestra.run.smithi043.stdout:60129542151 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f59fc06be30 msgr2=0x7f59fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f59fc06be30 0x7f59fc06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c141550 tx=0x7f5a10009040 comp rx=0 tx=0).stop 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 msgr2=0x7f5a1c1415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 0x7f5a1c1415a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00c3f0 tx=0x7f5a0c00c8b0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 shutdown_connections 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f59fc06be30 0x7f59fc06e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5a1c151430 0x7f5a1c14f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a1c0cf050 0x7f5a1c140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 --2- 172.21.15.43:0/2071131042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a1c06b390 0x7f5a1c1415a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.950+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 >> 172.21.15.43:0/2071131042 conn(0x7f5a1c0b14b0 msgr2=0x7f5a1c06e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.951+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 shutdown_connections 2024-06-13T11:37:25.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.951+0000 7f5a20b9e640 1 -- 172.21.15.43:0/2071131042 wait complete. 2024-06-13T11:37:25.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.956+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6eb00b2850 con 0x7f6eb0137750 2024-06-13T11:37:25.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.957+0000 7f6ead7fa640 1 -- 172.21.15.43:0/3615707643 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6eb015b6c0 con 0x7f6eb0137750 2024-06-13T11:37:25.956 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:25.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.958+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd40c005fb0 con 0x7fd40c0589d0 2024-06-13T11:37:25.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.959+0000 7fd409ffb640 1 -- 172.21.15.43:0/1069000288 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4140688e0 con 0x7fd40c0589d0 2024-06-13T11:37:25.958 INFO:teuthology.orchestra.run.smithi043.stdout:55834574856 2024-06-13T11:37:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7718005580 con 0x7f7728037fe0 2024-06-13T11:37:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f6e9006bf30 msgr2=0x7f6e9006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f6e9006bf30 0x7f6e9006e3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00cfb90 tx=0x7f6e98008040 comp rx=0 tx=0).stop 2024-06-13T11:37:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 msgr2=0x7f6eb0137c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 0x7f6eb0137c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c760 tx=0x7f6ea800cc20 comp rx=0 tx=0).stop 2024-06-13T11:37:25.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 shutdown_connections 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f6e9006bf30 0x7f6e9006e3f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f6eb0137750 0x7f6eb0137c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6eb015be60 0x7f6eb0072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 --2- 172.21.15.43:0/3615707643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb013dee0 0x7f6eb0153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 >> 172.21.15.43:0/3615707643 conn(0x7f6eb00671f0 msgr2=0x7f6eb013b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.960+0000 7f77267fc640 1 -- 172.21.15.43:0/3583118752 <== mon.2 v2:172.21.15.53:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f772c05c6f0 con 0x7f7728037fe0 2024-06-13T11:37:25.961 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.962 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:25.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.961+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 shutdown_connections 2024-06-13T11:37:25.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.961+0000 7f6eb71ee640 1 -- 172.21.15.43:0/3615707643 wait complete. 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd3f806bf60 msgr2=0x7fd3f806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd3f806bf60 0x7fd3f806e420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd410000c00 tx=0x7fd41002e000 comp rx=0 tx=0).stop 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 msgr2=0x7fd40c00d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 0x7fd40c00d680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd414064ec0 tx=0x7fd4140687b0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 shutdown_connections 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd3f806bf60 0x7fd3f806e420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd40c0e1f60 0x7fd40c0dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd40c0589d0 0x7fd40c00d680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 --2- 172.21.15.43:0/1069000288 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd40c053c50 0x7fd40c0dd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.962+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 >> 172.21.15.43:0/1069000288 conn(0x7fd40c058ef0 msgr2=0x7fd40c0e6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.963+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 shutdown_connections 2024-06-13T11:37:25.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.963+0000 7fd3ff7fe640 1 -- 172.21.15.43:0/1069000288 wait complete. 2024-06-13T11:37:25.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.963+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f771406bf30 msgr2=0x7f771406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.963+0000 7f7736885640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f771406bf30 0x7f771406e3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f773006ac20 tx=0x7f773007ad50 comp rx=0 tx=0).stop 2024-06-13T11:37:25.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.963+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 msgr2=0x7f77280e69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.963+0000 7f7736885640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 0x7f77280e69f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c4d0 tx=0x7f772c00c990 comp rx=0 tx=0).stop 2024-06-13T11:37:25.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 shutdown_connections 2024-06-13T11:37:25.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f771406bf30 0x7f771406e3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77280f00b0 0x7f77280e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f772803c100 0x7f77280e19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 --2- 172.21.15.43:0/3583118752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7728037fe0 0x7f77280e69f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 >> 172.21.15.43:0/3583118752 conn(0x7f7728058ef0 msgr2=0x7f77280592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 shutdown_connections 2024-06-13T11:37:25.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.964+0000 7f7736885640 1 -- 172.21.15.43:0/3583118752 wait complete. 2024-06-13T11:37:25.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-06-13T11:37:25.966 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.971+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd260005850 con 0x7fd27c072c50 2024-06-13T11:37:25.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.972+0000 7fd273fff640 1 -- 172.21.15.43:0/2281869276 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2640600d0 con 0x7fd27c072c50 2024-06-13T11:37:25.971 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-06-13T11:37:25.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-06-13T11:37:25.975 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd25c06be30 msgr2=0x7fd25c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd25c06be30 0x7fd25c06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd26c034000 tx=0x7fd26c02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 msgr2=0x7fd27c1f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 0x7fd27c1f5ff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd26400e890 tx=0x7fd26400ed50 comp rx=0 tx=0).stop 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 shutdown_connections 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fd25c06be30 0x7fd25c06e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd27c0cc3e0 0x7fd27c138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd27c072c50 0x7fd27c1f5ff0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 --2- 172.21.15.43:0/2281869276 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fd27c06ee60 0x7fd27c1f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 >> 172.21.15.43:0/2281869276 conn(0x7fd27c067610 msgr2=0x7fd27c06d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 shutdown_connections 2024-06-13T11:37:25.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.975+0000 7fd280d0e640 1 -- 172.21.15.43:0/2281869276 wait complete. 2024-06-13T11:37:25.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2024-06-13T11:37:25.981 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-06-13T11:37:25.982 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.987+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f42b415f020 con 0x7f42b40ce3c0 2024-06-13T11:37:25.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.987+0000 7f42a2ffd640 1 -- 172.21.15.43:0/1996454910 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42a405db20 con 0x7f42b40ce3c0 2024-06-13T11:37:25.986 INFO:teuthology.orchestra.run.smithi043.stdout:60129542152 2024-06-13T11:37:25.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f429406be30 msgr2=0x7f429406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f429406be30 0x7f429406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42a8034000 tx=0x7f42a802e000 comp rx=0 tx=0).stop 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b40ce3c0 msgr2=0x7f42b4149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b40ce3c0 0x7f42b4149ff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42a400e930 tx=0x7f42a400edf0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 shutdown_connections 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f429406be30 0x7f429406e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f42b4166c00 0x7f42b414a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42b40ce3c0 0x7f42b4149ff0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 --2- 172.21.15.43:0/1996454910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42b40b0ef0 0x7f42b4146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 >> 172.21.15.43:0/1996454910 conn(0x7f42b4067640 msgr2=0x7f42b41655d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 shutdown_connections 2024-06-13T11:37:25.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:25.989+0000 7f42b8b90640 1 -- 172.21.15.43:0/1996454910 wait complete. 2024-06-13T11:37:25.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-06-13T11:37:25.990 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2024-06-13T11:37:25.999 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:25.999 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-13T11:37:26.000 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:37:26.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.144+0000 7f191f90f640 1 Processor -- start 2024-06-13T11:37:26.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.145+0000 7f191f90f640 1 -- start start 2024-06-13T11:37:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.145+0000 7f191f90f640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19180d2a90 0x7f19180d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.145+0000 7f191f90f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19180abe00 0x7f19180ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.145+0000 7f191f90f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19180aa5d0 con 0x7f1918155420 2024-06-13T11:37:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.145+0000 7f191f90f640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f19180d3410 con 0x7f19180abe00 2024-06-13T11:37:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.145+0000 7f191f90f640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f19180aeb90 con 0x7f19180d2a90 2024-06-13T11:37:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19180abe00 0x7f19180ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19180abe00 0x7f19180ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47750/0 (socket says 172.21.15.43:47750) 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 -- 172.21.15.43:0/383979615 learned_addr learned my addr 172.21.15.43:0/383979615 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191ceaa640 1 --2- 172.21.15.43:0/383979615 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19180d2a90 0x7f19180d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 -- 172.21.15.43:0/383979615 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19180d2a90 msgr2=0x7f19180d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 --2- 172.21.15.43:0/383979615 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19180d2a90 0x7f19180d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 -- 172.21.15.43:0/383979615 >> v1:172.21.15.53:6789/0 conn(0x7f1918155420 legacy=0x7f19180ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.146+0000 7f191deac640 1 -- 172.21.15.43:0/383979615 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1918155800 con 0x7f19180abe00 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191deac640 1 --2- 172.21.15.43:0/383979615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180abe00 0x7f19180ac240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1910009e50 tx=0x7f191002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf47904b698929b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f190ffff640 1 -- 172.21.15.43:0/383979615 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910036070 con 0x7f19180abe00 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f190ffff640 1 -- 172.21.15.43:0/383979615 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1910031600 con 0x7f19180abe00 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f190ffff640 1 -- 172.21.15.43:0/383979615 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100319d0 con 0x7f19180abe00 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 -- 172.21.15.43:0/383979615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180abe00 msgr2=0x7f19180ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 --2- 172.21.15.43:0/383979615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180abe00 0x7f19180ac240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1910009e50 tx=0x7f191002a710 comp rx=0 tx=0).stop 2024-06-13T11:37:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 -- 172.21.15.43:0/383979615 shutdown_connections 2024-06-13T11:37:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 --2- 172.21.15.43:0/383979615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180abe00 0x7f19180ac240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 --2- 172.21.15.43:0/383979615 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f19180d2a90 0x7f19180d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 -- 172.21.15.43:0/383979615 >> 172.21.15.43:0/383979615 conn(0x7f1918067640 msgr2=0x7f19180d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.147+0000 7f191f90f640 1 -- 172.21.15.43:0/383979615 shutdown_connections 2024-06-13T11:37:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.148+0000 7f191f90f640 1 -- 172.21.15.43:0/383979615 wait complete. 2024-06-13T11:37:26.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 Processor -- start 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 -- start start 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19180abe00 0x7f19181f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 0x7f191814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1918155420 0x7f191814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f19180aae30 con 0x7f19180d2a90 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f19180aab50 con 0x7f19180abe00 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191f90f640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f19180ab110 con 0x7f1918155420 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.149+0000 7f191ceaa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 0x7f191814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 0x7f191814d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47764/0 (socket says 172.21.15.43:47764) 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 -- 172.21.15.43:0/2426496118 learned_addr learned my addr 172.21.15.43:0/2426496118 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191d6ab640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19180abe00 0x7f19181f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191deac640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1918155420 0x7f191814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 -- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1918155420 msgr2=0x7f191814da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1918155420 0x7f191814da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 -- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19180abe00 msgr2=0x7f19181f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19180abe00 0x7f19181f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 -- 172.21.15.43:0/2426496118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19181f4e50 con 0x7f19180d2a90 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191ceaa640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 0x7f191814d500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f190800d800 tx=0x7f190800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190800b6c0 con 0x7f19180d2a90 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908019070 con 0x7f19180d2a90 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19181f5130 con 0x7f19180d2a90 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190800bac0 con 0x7f19180d2a90 2024-06-13T11:37:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.150+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191815bb40 con 0x7f19180d2a90 2024-06-13T11:37:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.151+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19181f5300 con 0x7f19180d2a90 2024-06-13T11:37:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.152+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f190800bc60 con 0x7f19180d2a90 2024-06-13T11:37:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.152+0000 7f190dffb640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f18fc06be30 0x7f18fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.152+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f190808b490 con 0x7f19180d2a90 2024-06-13T11:37:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.152+0000 7f191d6ab640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f18fc06be30 0x7f18fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.153+0000 7f191d6ab640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f18fc06be30 0x7f18fc06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1918071990 tx=0x7f1914009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.157+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1908059540 con 0x7f19180d2a90 2024-06-13T11:37:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.334+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f191804ffb0 con 0x7f18fc06be30 2024-06-13T11:37:26.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.343+0000 7f190dffb640 1 -- 172.21.15.43:0/2426496118 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f191804ffb0 con 0x7f18fc06be30 2024-06-13T11:37:26.346 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:26.347 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f18fc06be30 msgr2=0x7f18fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f18fc06be30 0x7f18fc06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1918071990 tx=0x7f1914009040 comp rx=0 tx=0).stop 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 msgr2=0x7f191814d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 0x7f191814d500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f190800d800 tx=0x7f190800dcc0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 shutdown_connections 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f18fc06be30 0x7f18fc06e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f1918155420 0x7f191814da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19180d2a90 0x7f191814d500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 --2- 172.21.15.43:0/2426496118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19180abe00 0x7f19181f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.346+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 >> 172.21.15.43:0/2426496118 conn(0x7f1918067640 msgr2=0x7f19180adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:26.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.347+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 shutdown_connections 2024-06-13T11:37:26.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.347+0000 7f191f90f640 1 -- 172.21.15.43:0/2426496118 wait complete. 2024-06-13T11:37:26.357 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-06-13T11:37:25.353164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252720,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722000,"statfs":{"total":773094113280,"available":772835328000,"internally_reserved":0,"allocated":3350528,"data_stored":2019542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003178"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713160+0000","last_change":"2024-06-13T11:37:06.802024+0000","last_active":"2024-06-13T11:37:13.713160+0000","last_peered":"2024-06-13T11:37:13.713160+0000","last_clean":"2024-06-13T11:37:13.713160+0000","last_became_active":"2024-06-13T11:37:06.801691+0000","last_became_peered":"2024-06-13T11:37:06.801691+0000","last_unstale":"2024-06-13T11:37:13.713160+0000","last_undegraded":"2024-06-13T11:37:13.713160+0000","last_fullsized":"2024-06-13T11:37:13.713160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713972+0000","last_change":"2024-06-13T11:37:07.811931+0000","last_active":"2024-06-13T11:37:13.713972+0000","last_peered":"2024-06-13T11:37:13.713972+0000","last_clean":"2024-06-13T11:37:13.713972+0000","last_became_active":"2024-06-13T11:37:07.811664+0000","last_became_peered":"2024-06-13T11:37:07.811664+0000","last_unstale":"2024-06-13T11:37:13.713972+0000","last_undegraded":"2024-06-13T11:37:13.713972+0000","last_fullsized":"2024-06-13T11:37:13.713972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713382+0000","last_change":"2024-06-13T11:37:12.056726+0000","last_active":"2024-06-13T11:37:13.713382+0000","last_peered":"2024-06-13T11:37:13.713382+0000","last_clean":"2024-06-13T11:37:13.713382+0000","last_became_active":"2024-06-13T11:37:12.056325+0000","last_became_peered":"2024-06-13T11:37:12.056325+0000","last_unstale":"2024-06-13T11:37:13.713382+0000","last_undegraded":"2024-06-13T11:37:13.713382+0000","last_fullsized":"2024-06-13T11:37:13.713382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.767571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714115+0000","last_change":"2024-06-13T11:37:06.796164+0000","last_active":"2024-06-13T11:37:13.714115+0000","last_peered":"2024-06-13T11:37:13.714115+0000","last_clean":"2024-06-13T11:37:13.714115+0000","last_became_active":"2024-06-13T11:37:06.795879+0000","last_became_peered":"2024-06-13T11:37:06.795879+0000","last_unstale":"2024-06-13T11:37:13.714115+0000","last_undegraded":"2024-06-13T11:37:13.714115+0000","last_fullsized":"2024-06-13T11:37:13.714115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712971+0000","last_change":"2024-06-13T11:37:07.816817+0000","last_active":"2024-06-13T11:37:13.712971+0000","last_peered":"2024-06-13T11:37:13.712971+0000","last_clean":"2024-06-13T11:37:13.712971+0000","last_became_active":"2024-06-13T11:37:07.816501+0000","last_became_peered":"2024-06-13T11:37:07.816501+0000","last_unstale":"2024-06-13T11:37:13.712971+0000","last_undegraded":"2024-06-13T11:37:13.712971+0000","last_fullsized":"2024-06-13T11:37:13.712971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819271+0000","last_change":"2024-06-13T11:37:11.840979+0000","last_active":"2024-06-13T11:37:12.819271+0000","last_peered":"2024-06-13T11:37:12.819271+0000","last_clean":"2024-06-13T11:37:12.819271+0000","last_became_active":"2024-06-13T11:37:11.840530+0000","last_became_peered":"2024-06-13T11:37:11.840530+0000","last_unstale":"2024-06-13T11:37:12.819271+0000","last_undegraded":"2024-06-13T11:37:12.819271+0000","last_fullsized":"2024-06-13T11:37:12.819271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:49.007922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152993+0000","last_change":"2024-06-13T11:37:06.804220+0000","last_active":"2024-06-13T11:37:13.152993+0000","last_peered":"2024-06-13T11:37:13.152993+0000","last_clean":"2024-06-13T11:37:13.152993+0000","last_became_active":"2024-06-13T11:37:06.803905+0000","last_became_peered":"2024-06-13T11:37:06.803905+0000","last_unstale":"2024-06-13T11:37:13.152993+0000","last_undegraded":"2024-06-13T11:37:13.152993+0000","last_fullsized":"2024-06-13T11:37:13.152993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168438+0000","last_change":"2024-06-13T11:37:07.818064+0000","last_active":"2024-06-13T11:37:13.168438+0000","last_peered":"2024-06-13T11:37:13.168438+0000","last_clean":"2024-06-13T11:37:13.168438+0000","last_became_active":"2024-06-13T11:37:07.817790+0000","last_became_peered":"2024-06-13T11:37:07.817790+0000","last_unstale":"2024-06-13T11:37:13.168438+0000","last_undegraded":"2024-06-13T11:37:13.168438+0000","last_fullsized":"2024-06-13T11:37:13.168438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819367+0000","last_change":"2024-06-13T11:37:11.843208+0000","last_active":"2024-06-13T11:37:12.819367+0000","last_peered":"2024-06-13T11:37:12.819367+0000","last_clean":"2024-06-13T11:37:12.819367+0000","last_became_active":"2024-06-13T11:37:11.842808+0000","last_became_peered":"2024-06-13T11:37:11.842808+0000","last_unstale":"2024-06-13T11:37:12.819367+0000","last_undegraded":"2024-06-13T11:37:12.819367+0000","last_fullsized":"2024-06-13T11:37:12.819367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:39.425819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152791+0000","last_change":"2024-06-13T11:37:06.806036+0000","last_active":"2024-06-13T11:37:13.152791+0000","last_peered":"2024-06-13T11:37:13.152791+0000","last_clean":"2024-06-13T11:37:13.152791+0000","last_became_active":"2024-06-13T11:37:06.805633+0000","last_became_peered":"2024-06-13T11:37:06.805633+0000","last_unstale":"2024-06-13T11:37:13.152791+0000","last_undegraded":"2024-06-13T11:37:13.152791+0000","last_fullsized":"2024-06-13T11:37:13.152791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168608+0000","last_change":"2024-06-13T11:37:07.818181+0000","last_active":"2024-06-13T11:37:13.168608+0000","last_peered":"2024-06-13T11:37:13.168608+0000","last_clean":"2024-06-13T11:37:13.168608+0000","last_became_active":"2024-06-13T11:37:07.817838+0000","last_became_peered":"2024-06-13T11:37:07.817838+0000","last_unstale":"2024-06-13T11:37:13.168608+0000","last_undegraded":"2024-06-13T11:37:13.168608+0000","last_fullsized":"2024-06-13T11:37:13.168608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819379+0000","last_change":"2024-06-13T11:37:11.836030+0000","last_active":"2024-06-13T11:37:12.819379+0000","last_peered":"2024-06-13T11:37:12.819379+0000","last_clean":"2024-06-13T11:37:12.819379+0000","last_became_active":"2024-06-13T11:37:11.835623+0000","last_became_peered":"2024-06-13T11:37:11.835623+0000","last_unstale":"2024-06-13T11:37:12.819379+0000","last_undegraded":"2024-06-13T11:37:12.819379+0000","last_fullsized":"2024-06-13T11:37:12.819379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:15.824916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821023+0000","last_change":"2024-06-13T11:37:07.801421+0000","last_active":"2024-06-13T11:37:12.821023+0000","last_peered":"2024-06-13T11:37:12.821023+0000","last_clean":"2024-06-13T11:37:12.821023+0000","last_became_active":"2024-06-13T11:37:07.801091+0000","last_became_peered":"2024-06-13T11:37:07.801091+0000","last_unstale":"2024-06-13T11:37:12.821023+0000","last_undegraded":"2024-06-13T11:37:12.821023+0000","last_fullsized":"2024-06-13T11:37:12.821023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152797+0000","last_change":"2024-06-13T11:37:06.800654+0000","last_active":"2024-06-13T11:37:13.152797+0000","last_peered":"2024-06-13T11:37:13.152797+0000","last_clean":"2024-06-13T11:37:13.152797+0000","last_became_active":"2024-06-13T11:37:06.800354+0000","last_became_peered":"2024-06-13T11:37:06.800354+0000","last_unstale":"2024-06-13T11:37:13.152797+0000","last_undegraded":"2024-06-13T11:37:13.152797+0000","last_fullsized":"2024-06-13T11:37:13.152797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:30.194270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821793+0000","last_change":"2024-06-13T11:37:11.844730+0000","last_active":"2024-06-13T11:37:12.821793+0000","last_peered":"2024-06-13T11:37:12.821793+0000","last_clean":"2024-06-13T11:37:12.821793+0000","last_became_active":"2024-06-13T11:37:11.844339+0000","last_became_peered":"2024-06-13T11:37:11.844339+0000","last_unstale":"2024-06-13T11:37:12.821793+0000","last_undegraded":"2024-06-13T11:37:12.821793+0000","last_fullsized":"2024-06-13T11:37:12.821793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:55.671685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713768+0000","last_change":"2024-06-13T11:37:07.814526+0000","last_active":"2024-06-13T11:37:13.713768+0000","last_peered":"2024-06-13T11:37:13.713768+0000","last_clean":"2024-06-13T11:37:13.713768+0000","last_became_active":"2024-06-13T11:37:07.814074+0000","last_became_peered":"2024-06-13T11:37:07.814074+0000","last_unstale":"2024-06-13T11:37:13.713768+0000","last_undegraded":"2024-06-13T11:37:13.713768+0000","last_fullsized":"2024-06-13T11:37:13.713768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820029+0000","last_change":"2024-06-13T11:37:06.796287+0000","last_active":"2024-06-13T11:37:12.820029+0000","last_peered":"2024-06-13T11:37:12.820029+0000","last_clean":"2024-06-13T11:37:12.820029+0000","last_became_active":"2024-06-13T11:37:06.796000+0000","last_became_peered":"2024-06-13T11:37:06.796000+0000","last_unstale":"2024-06-13T11:37:12.820029+0000","last_undegraded":"2024-06-13T11:37:12.820029+0000","last_fullsized":"2024-06-13T11:37:12.820029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820470+0000","last_change":"2024-06-13T11:37:11.842232+0000","last_active":"2024-06-13T11:37:12.820470+0000","last_peered":"2024-06-13T11:37:12.820470+0000","last_clean":"2024-06-13T11:37:12.820470+0000","last_became_active":"2024-06-13T11:37:11.841627+0000","last_became_peered":"2024-06-13T11:37:11.841627+0000","last_unstale":"2024-06-13T11:37:12.820470+0000","last_undegraded":"2024-06-13T11:37:12.820470+0000","last_fullsized":"2024-06-13T11:37:12.820470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:18.353072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712704+0000","last_change":"2024-06-13T11:37:07.811429+0000","last_active":"2024-06-13T11:37:13.712704+0000","last_peered":"2024-06-13T11:37:13.712704+0000","last_clean":"2024-06-13T11:37:13.712704+0000","last_became_active":"2024-06-13T11:37:07.811115+0000","last_became_peered":"2024-06-13T11:37:07.811115+0000","last_unstale":"2024-06-13T11:37:13.712704+0000","last_undegraded":"2024-06-13T11:37:13.712704+0000","last_fullsized":"2024-06-13T11:37:13.712704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819414+0000","last_change":"2024-06-13T11:37:06.800946+0000","last_active":"2024-06-13T11:37:12.819414+0000","last_peered":"2024-06-13T11:37:12.819414+0000","last_clean":"2024-06-13T11:37:12.819414+0000","last_became_active":"2024-06-13T11:37:06.800694+0000","last_became_peered":"2024-06-13T11:37:06.800694+0000","last_unstale":"2024-06-13T11:37:12.819414+0000","last_undegraded":"2024-06-13T11:37:12.819414+0000","last_fullsized":"2024-06-13T11:37:12.819414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820472+0000","last_change":"2024-06-13T11:37:12.056325+0000","last_active":"2024-06-13T11:37:12.820472+0000","last_peered":"2024-06-13T11:37:12.820472+0000","last_clean":"2024-06-13T11:37:12.820472+0000","last_became_active":"2024-06-13T11:37:12.055942+0000","last_became_peered":"2024-06-13T11:37:12.055942+0000","last_unstale":"2024-06-13T11:37:12.820472+0000","last_undegraded":"2024-06-13T11:37:12.820472+0000","last_fullsized":"2024-06-13T11:37:12.820472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819614+0000","last_change":"2024-06-13T11:37:07.802398+0000","last_active":"2024-06-13T11:37:12.819614+0000","last_peered":"2024-06-13T11:37:12.819614+0000","last_clean":"2024-06-13T11:37:12.819614+0000","last_became_active":"2024-06-13T11:37:07.799881+0000","last_became_peered":"2024-06-13T11:37:07.799881+0000","last_unstale":"2024-06-13T11:37:12.819614+0000","last_undegraded":"2024-06-13T11:37:12.819614+0000","last_fullsized":"2024-06-13T11:37:12.819614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:48.876977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152403+0000","last_change":"2024-06-13T11:37:06.801936+0000","last_active":"2024-06-13T11:37:13.152403+0000","last_peered":"2024-06-13T11:37:13.152403+0000","last_clean":"2024-06-13T11:37:13.152403+0000","last_became_active":"2024-06-13T11:37:06.801627+0000","last_became_peered":"2024-06-13T11:37:06.801627+0000","last_unstale":"2024-06-13T11:37:13.152403+0000","last_undegraded":"2024-06-13T11:37:13.152403+0000","last_fullsized":"2024-06-13T11:37:13.152403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:47.872930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821463+0000","last_change":"2024-06-13T11:37:11.842008+0000","last_active":"2024-06-13T11:37:12.821463+0000","last_peered":"2024-06-13T11:37:12.821463+0000","last_clean":"2024-06-13T11:37:12.821463+0000","last_became_active":"2024-06-13T11:37:11.840561+0000","last_became_peered":"2024-06-13T11:37:11.840561+0000","last_unstale":"2024-06-13T11:37:12.821463+0000","last_undegraded":"2024-06-13T11:37:12.821463+0000","last_fullsized":"2024-06-13T11:37:12.821463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:08.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713459+0000","last_change":"2024-06-13T11:37:07.805913+0000","last_active":"2024-06-13T11:37:13.713459+0000","last_peered":"2024-06-13T11:37:13.713459+0000","last_clean":"2024-06-13T11:37:13.713459+0000","last_became_active":"2024-06-13T11:37:07.805604+0000","last_became_peered":"2024-06-13T11:37:07.805604+0000","last_unstale":"2024-06-13T11:37:13.713459+0000","last_undegraded":"2024-06-13T11:37:13.713459+0000","last_fullsized":"2024-06-13T11:37:13.713459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821692+0000","last_change":"2024-06-13T11:37:06.798167+0000","last_active":"2024-06-13T11:37:12.821692+0000","last_peered":"2024-06-13T11:37:12.821692+0000","last_clean":"2024-06-13T11:37:12.821692+0000","last_became_active":"2024-06-13T11:37:06.797830+0000","last_became_peered":"2024-06-13T11:37:06.797830+0000","last_unstale":"2024-06-13T11:37:12.821692+0000","last_undegraded":"2024-06-13T11:37:12.821692+0000","last_fullsized":"2024-06-13T11:37:12.821692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819540+0000","last_change":"2024-06-13T11:37:12.061010+0000","last_active":"2024-06-13T11:37:12.819540+0000","last_peered":"2024-06-13T11:37:12.819540+0000","last_clean":"2024-06-13T11:37:12.819540+0000","last_became_active":"2024-06-13T11:37:12.059153+0000","last_became_peered":"2024-06-13T11:37:12.059153+0000","last_unstale":"2024-06-13T11:37:12.819540+0000","last_undegraded":"2024-06-13T11:37:12.819540+0000","last_fullsized":"2024-06-13T11:37:12.819540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:51.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714310+0000","last_change":"2024-06-13T11:37:07.813451+0000","last_active":"2024-06-13T11:37:13.714310+0000","last_peered":"2024-06-13T11:37:13.714310+0000","last_clean":"2024-06-13T11:37:13.714310+0000","last_became_active":"2024-06-13T11:37:07.813139+0000","last_became_peered":"2024-06-13T11:37:07.813139+0000","last_unstale":"2024-06-13T11:37:13.714310+0000","last_undegraded":"2024-06-13T11:37:13.714310+0000","last_fullsized":"2024-06-13T11:37:13.714310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820425+0000","last_change":"2024-06-13T11:37:06.791276+0000","last_active":"2024-06-13T11:37:12.820425+0000","last_peered":"2024-06-13T11:37:12.820425+0000","last_clean":"2024-06-13T11:37:12.820425+0000","last_became_active":"2024-06-13T11:37:06.790984+0000","last_became_peered":"2024-06-13T11:37:06.790984+0000","last_unstale":"2024-06-13T11:37:12.820425+0000","last_undegraded":"2024-06-13T11:37:12.820425+0000","last_fullsized":"2024-06-13T11:37:12.820425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712213+0000","last_change":"2024-06-13T11:37:12.056185+0000","last_active":"2024-06-13T11:37:13.712213+0000","last_peered":"2024-06-13T11:37:13.712213+0000","last_clean":"2024-06-13T11:37:13.712213+0000","last_became_active":"2024-06-13T11:37:12.055801+0000","last_became_peered":"2024-06-13T11:37:12.055801+0000","last_unstale":"2024-06-13T11:37:13.712213+0000","last_undegraded":"2024-06-13T11:37:13.712213+0000","last_fullsized":"2024-06-13T11:37:13.712213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:48:35.821250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820132+0000","last_change":"2024-06-13T11:37:07.806070+0000","last_active":"2024-06-13T11:37:12.820132+0000","last_peered":"2024-06-13T11:37:12.820132+0000","last_clean":"2024-06-13T11:37:12.820132+0000","last_became_active":"2024-06-13T11:37:07.805709+0000","last_became_peered":"2024-06-13T11:37:07.805709+0000","last_unstale":"2024-06-13T11:37:12.820132+0000","last_undegraded":"2024-06-13T11:37:12.820132+0000","last_fullsized":"2024-06-13T11:37:12.820132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153136+0000","last_change":"2024-06-13T11:37:06.802281+0000","last_active":"2024-06-13T11:37:13.153136+0000","last_peered":"2024-06-13T11:37:13.153136+0000","last_clean":"2024-06-13T11:37:13.153136+0000","last_became_active":"2024-06-13T11:37:06.801980+0000","last_became_peered":"2024-06-13T11:37:06.801980+0000","last_unstale":"2024-06-13T11:37:13.153136+0000","last_undegraded":"2024-06-13T11:37:13.153136+0000","last_fullsized":"2024-06-13T11:37:13.153136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:12.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713126+0000","last_change":"2024-06-13T11:37:12.058285+0000","last_active":"2024-06-13T11:37:13.713126+0000","last_peered":"2024-06-13T11:37:13.713126+0000","last_clean":"2024-06-13T11:37:13.713126+0000","last_became_active":"2024-06-13T11:37:12.056488+0000","last_became_peered":"2024-06-13T11:37:12.056488+0000","last_unstale":"2024-06-13T11:37:13.713126+0000","last_undegraded":"2024-06-13T11:37:13.713126+0000","last_fullsized":"2024-06-13T11:37:13.713126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168770+0000","last_change":"2024-06-13T11:37:07.819314+0000","last_active":"2024-06-13T11:37:13.168770+0000","last_peered":"2024-06-13T11:37:13.168770+0000","last_clean":"2024-06-13T11:37:13.168770+0000","last_became_active":"2024-06-13T11:37:07.819030+0000","last_became_peered":"2024-06-13T11:37:07.819030+0000","last_unstale":"2024-06-13T11:37:13.168770+0000","last_undegraded":"2024-06-13T11:37:13.168770+0000","last_fullsized":"2024-06-13T11:37:13.168770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820299+0000","last_change":"2024-06-13T11:37:06.793665+0000","last_active":"2024-06-13T11:37:12.820299+0000","last_peered":"2024-06-13T11:37:12.820299+0000","last_clean":"2024-06-13T11:37:12.820299+0000","last_became_active":"2024-06-13T11:37:06.793369+0000","last_became_peered":"2024-06-13T11:37:06.793369+0000","last_unstale":"2024-06-13T11:37:12.820299+0000","last_undegraded":"2024-06-13T11:37:12.820299+0000","last_fullsized":"2024-06-13T11:37:12.820299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819444+0000","last_change":"2024-06-13T11:37:11.840712+0000","last_active":"2024-06-13T11:37:12.819444+0000","last_peered":"2024-06-13T11:37:12.819444+0000","last_clean":"2024-06-13T11:37:12.819444+0000","last_became_active":"2024-06-13T11:37:11.840256+0000","last_became_peered":"2024-06-13T11:37:11.840256+0000","last_unstale":"2024-06-13T11:37:12.819444+0000","last_undegraded":"2024-06-13T11:37:12.819444+0000","last_fullsized":"2024-06-13T11:37:12.819444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820268+0000","last_change":"2024-06-13T11:37:07.814284+0000","last_active":"2024-06-13T11:37:12.820268+0000","last_peered":"2024-06-13T11:37:12.820268+0000","last_clean":"2024-06-13T11:37:12.820268+0000","last_became_active":"2024-06-13T11:37:07.813867+0000","last_became_peered":"2024-06-13T11:37:07.813867+0000","last_unstale":"2024-06-13T11:37:12.820268+0000","last_undegraded":"2024-06-13T11:37:12.820268+0000","last_fullsized":"2024-06-13T11:37:12.820268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:31.198317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168467+0000","last_change":"2024-06-13T11:37:06.805668+0000","last_active":"2024-06-13T11:37:13.168467+0000","last_peered":"2024-06-13T11:37:13.168467+0000","last_clean":"2024-06-13T11:37:13.168467+0000","last_became_active":"2024-06-13T11:37:06.803111+0000","last_became_peered":"2024-06-13T11:37:06.803111+0000","last_unstale":"2024-06-13T11:37:13.168467+0000","last_undegraded":"2024-06-13T11:37:13.168467+0000","last_fullsized":"2024-06-13T11:37:13.168467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820285+0000","last_change":"2024-06-13T11:37:11.841192+0000","last_active":"2024-06-13T11:37:12.820285+0000","last_peered":"2024-06-13T11:37:12.820285+0000","last_clean":"2024-06-13T11:37:12.820285+0000","last_became_active":"2024-06-13T11:37:11.840770+0000","last_became_peered":"2024-06-13T11:37:11.840770+0000","last_unstale":"2024-06-13T11:37:12.820285+0000","last_undegraded":"2024-06-13T11:37:12.820285+0000","last_fullsized":"2024-06-13T11:37:12.820285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819312+0000","last_change":"2024-06-13T11:37:07.806798+0000","last_active":"2024-06-13T11:37:12.819312+0000","last_peered":"2024-06-13T11:37:12.819312+0000","last_clean":"2024-06-13T11:37:12.819312+0000","last_became_active":"2024-06-13T11:37:07.806493+0000","last_became_peered":"2024-06-13T11:37:07.806493+0000","last_unstale":"2024-06-13T11:37:12.819312+0000","last_undegraded":"2024-06-13T11:37:12.819312+0000","last_fullsized":"2024-06-13T11:37:12.819312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712371+0000","last_change":"2024-06-13T11:37:06.797307+0000","last_active":"2024-06-13T11:37:13.712371+0000","last_peered":"2024-06-13T11:37:13.712371+0000","last_clean":"2024-06-13T11:37:13.712371+0000","last_became_active":"2024-06-13T11:37:06.796897+0000","last_became_peered":"2024-06-13T11:37:06.796897+0000","last_unstale":"2024-06-13T11:37:13.712371+0000","last_undegraded":"2024-06-13T11:37:13.712371+0000","last_fullsized":"2024-06-13T11:37:13.712371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820560+0000","last_change":"2024-06-13T11:37:11.842116+0000","last_active":"2024-06-13T11:37:12.820560+0000","last_peered":"2024-06-13T11:37:12.820560+0000","last_clean":"2024-06-13T11:37:12.820560+0000","last_became_active":"2024-06-13T11:37:11.841597+0000","last_became_peered":"2024-06-13T11:37:11.841597+0000","last_unstale":"2024-06-13T11:37:12.820560+0000","last_undegraded":"2024-06-13T11:37:12.820560+0000","last_fullsized":"2024-06-13T11:37:12.820560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712832+0000","last_change":"2024-06-13T11:37:07.808451+0000","last_active":"2024-06-13T11:37:13.712832+0000","last_peered":"2024-06-13T11:37:13.712832+0000","last_clean":"2024-06-13T11:37:13.712832+0000","last_became_active":"2024-06-13T11:37:07.808158+0000","last_became_peered":"2024-06-13T11:37:07.808158+0000","last_unstale":"2024-06-13T11:37:13.712832+0000","last_undegraded":"2024-06-13T11:37:13.712832+0000","last_fullsized":"2024-06-13T11:37:13.712832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:06:11.057302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152421+0000","last_change":"2024-06-13T11:37:06.804573+0000","last_active":"2024-06-13T11:37:13.152421+0000","last_peered":"2024-06-13T11:37:13.152421+0000","last_clean":"2024-06-13T11:37:13.152421+0000","last_became_active":"2024-06-13T11:37:06.804222+0000","last_became_peered":"2024-06-13T11:37:06.804222+0000","last_unstale":"2024-06-13T11:37:13.152421+0000","last_undegraded":"2024-06-13T11:37:13.152421+0000","last_fullsized":"2024-06-13T11:37:13.152421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:32.931150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713243+0000","last_change":"2024-06-13T11:37:12.057907+0000","last_active":"2024-06-13T11:37:13.713243+0000","last_peered":"2024-06-13T11:37:13.713243+0000","last_clean":"2024-06-13T11:37:13.713243+0000","last_became_active":"2024-06-13T11:37:12.056975+0000","last_became_peered":"2024-06-13T11:37:12.056975+0000","last_unstale":"2024-06-13T11:37:13.713243+0000","last_undegraded":"2024-06-13T11:37:13.713243+0000","last_fullsized":"2024-06-13T11:37:13.713243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713310+0000","last_change":"2024-06-13T11:37:07.812853+0000","last_active":"2024-06-13T11:37:13.713310+0000","last_peered":"2024-06-13T11:37:13.713310+0000","last_clean":"2024-06-13T11:37:13.713310+0000","last_became_active":"2024-06-13T11:37:07.812292+0000","last_became_peered":"2024-06-13T11:37:07.812292+0000","last_unstale":"2024-06-13T11:37:13.713310+0000","last_undegraded":"2024-06-13T11:37:13.713310+0000","last_fullsized":"2024-06-13T11:37:13.713310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:22.022588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168381+0000","last_change":"2024-06-13T11:37:06.801964+0000","last_active":"2024-06-13T11:37:13.168381+0000","last_peered":"2024-06-13T11:37:13.168381+0000","last_clean":"2024-06-13T11:37:13.168381+0000","last_became_active":"2024-06-13T11:37:06.801593+0000","last_became_peered":"2024-06-13T11:37:06.801593+0000","last_unstale":"2024-06-13T11:37:13.168381+0000","last_undegraded":"2024-06-13T11:37:13.168381+0000","last_fullsized":"2024-06-13T11:37:13.168381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152564+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:13.152564+0000","last_peered":"2024-06-13T11:37:13.152564+0000","last_clean":"2024-06-13T11:37:13.152564+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:13.152564+0000","last_undegraded":"2024-06-13T11:37:13.152564+0000","last_fullsized":"2024-06-13T11:37:13.152564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821546+0000","last_change":"2024-06-13T11:37:12.059771+0000","last_active":"2024-06-13T11:37:12.821546+0000","last_peered":"2024-06-13T11:37:12.821546+0000","last_clean":"2024-06-13T11:37:12.821546+0000","last_became_active":"2024-06-13T11:37:12.059321+0000","last_became_peered":"2024-06-13T11:37:12.059321+0000","last_unstale":"2024-06-13T11:37:12.821546+0000","last_undegraded":"2024-06-13T11:37:12.821546+0000","last_fullsized":"2024-06-13T11:37:12.821546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152859+0000","last_change":"2024-06-13T11:37:07.811589+0000","last_active":"2024-06-13T11:37:13.152859+0000","last_peered":"2024-06-13T11:37:13.152859+0000","last_clean":"2024-06-13T11:37:13.152859+0000","last_became_active":"2024-06-13T11:37:07.809978+0000","last_became_peered":"2024-06-13T11:37:07.809978+0000","last_unstale":"2024-06-13T11:37:13.152859+0000","last_undegraded":"2024-06-13T11:37:13.152859+0000","last_fullsized":"2024-06-13T11:37:13.152859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713015+0000","last_change":"2024-06-13T11:37:06.803922+0000","last_active":"2024-06-13T11:37:13.713015+0000","last_peered":"2024-06-13T11:37:13.713015+0000","last_clean":"2024-06-13T11:37:13.713015+0000","last_became_active":"2024-06-13T11:37:06.803580+0000","last_became_peered":"2024-06-13T11:37:06.803580+0000","last_unstale":"2024-06-13T11:37:13.713015+0000","last_undegraded":"2024-06-13T11:37:13.713015+0000","last_fullsized":"2024-06-13T11:37:13.713015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820954+0000","last_change":"2024-06-13T11:37:12.057052+0000","last_active":"2024-06-13T11:37:12.820954+0000","last_peered":"2024-06-13T11:37:12.820954+0000","last_clean":"2024-06-13T11:37:12.820954+0000","last_became_active":"2024-06-13T11:37:12.056584+0000","last_became_peered":"2024-06-13T11:37:12.056584+0000","last_unstale":"2024-06-13T11:37:12.820954+0000","last_undegraded":"2024-06-13T11:37:12.820954+0000","last_fullsized":"2024-06-13T11:37:12.820954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168499+0000","last_change":"2024-06-13T11:37:07.812006+0000","last_active":"2024-06-13T11:37:13.168499+0000","last_peered":"2024-06-13T11:37:13.168499+0000","last_clean":"2024-06-13T11:37:13.168499+0000","last_became_active":"2024-06-13T11:37:07.811291+0000","last_became_peered":"2024-06-13T11:37:07.811291+0000","last_unstale":"2024-06-13T11:37:13.168499+0000","last_undegraded":"2024-06-13T11:37:13.168499+0000","last_fullsized":"2024-06-13T11:37:13.168499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820081+0000","last_change":"2024-06-13T11:37:06.795354+0000","last_active":"2024-06-13T11:37:12.820081+0000","last_peered":"2024-06-13T11:37:12.820081+0000","last_clean":"2024-06-13T11:37:12.820081+0000","last_became_active":"2024-06-13T11:37:06.795061+0000","last_became_peered":"2024-06-13T11:37:06.795061+0000","last_unstale":"2024-06-13T11:37:12.820081+0000","last_undegraded":"2024-06-13T11:37:12.820081+0000","last_fullsized":"2024-06-13T11:37:12.820081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:03.016226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713370+0000","last_change":"2024-06-13T11:37:11.837119+0000","last_active":"2024-06-13T11:37:13.713370+0000","last_peered":"2024-06-13T11:37:13.713370+0000","last_clean":"2024-06-13T11:37:13.713370+0000","last_became_active":"2024-06-13T11:37:11.835585+0000","last_became_peered":"2024-06-13T11:37:11.835585+0000","last_unstale":"2024-06-13T11:37:13.713370+0000","last_undegraded":"2024-06-13T11:37:13.713370+0000","last_fullsized":"2024-06-13T11:37:13.713370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153245+0000","last_change":"2024-06-13T11:37:07.824375+0000","last_active":"2024-06-13T11:37:13.153245+0000","last_peered":"2024-06-13T11:37:13.153245+0000","last_clean":"2024-06-13T11:37:13.153245+0000","last_became_active":"2024-06-13T11:37:07.823632+0000","last_became_peered":"2024-06-13T11:37:07.823632+0000","last_unstale":"2024-06-13T11:37:13.153245+0000","last_undegraded":"2024-06-13T11:37:13.153245+0000","last_fullsized":"2024-06-13T11:37:13.153245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:31:03.309590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712454+0000","last_change":"2024-06-13T11:37:06.795631+0000","last_active":"2024-06-13T11:37:13.712454+0000","last_peered":"2024-06-13T11:37:13.712454+0000","last_clean":"2024-06-13T11:37:13.712454+0000","last_became_active":"2024-06-13T11:37:06.795324+0000","last_became_peered":"2024-06-13T11:37:06.795324+0000","last_unstale":"2024-06-13T11:37:13.712454+0000","last_undegraded":"2024-06-13T11:37:13.712454+0000","last_fullsized":"2024-06-13T11:37:13.712454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168005+0000","last_change":"2024-06-13T11:37:12.057488+0000","last_active":"2024-06-13T11:37:13.168005+0000","last_peered":"2024-06-13T11:37:13.168005+0000","last_clean":"2024-06-13T11:37:13.168005+0000","last_became_active":"2024-06-13T11:37:12.055585+0000","last_became_peered":"2024-06-13T11:37:12.055585+0000","last_unstale":"2024-06-13T11:37:13.168005+0000","last_undegraded":"2024-06-13T11:37:13.168005+0000","last_fullsized":"2024-06-13T11:37:13.168005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:50:00.925587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153108+0000","last_change":"2024-06-13T11:37:07.820932+0000","last_active":"2024-06-13T11:37:13.153108+0000","last_peered":"2024-06-13T11:37:13.153108+0000","last_clean":"2024-06-13T11:37:13.153108+0000","last_became_active":"2024-06-13T11:37:07.820617+0000","last_became_peered":"2024-06-13T11:37:07.820617+0000","last_unstale":"2024-06-13T11:37:13.153108+0000","last_undegraded":"2024-06-13T11:37:13.153108+0000","last_fullsized":"2024-06-13T11:37:13.153108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821493+0000","last_change":"2024-06-13T11:37:06.794223+0000","last_active":"2024-06-13T11:37:12.821493+0000","last_peered":"2024-06-13T11:37:12.821493+0000","last_clean":"2024-06-13T11:37:12.821493+0000","last_became_active":"2024-06-13T11:37:06.793864+0000","last_became_peered":"2024-06-13T11:37:06.793864+0000","last_unstale":"2024-06-13T11:37:12.821493+0000","last_undegraded":"2024-06-13T11:37:12.821493+0000","last_fullsized":"2024-06-13T11:37:12.821493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819177+0000","last_change":"2024-06-13T11:37:11.840914+0000","last_active":"2024-06-13T11:37:12.819177+0000","last_peered":"2024-06-13T11:37:12.819177+0000","last_clean":"2024-06-13T11:37:12.819177+0000","last_became_active":"2024-06-13T11:37:11.840526+0000","last_became_peered":"2024-06-13T11:37:11.840526+0000","last_unstale":"2024-06-13T11:37:12.819177+0000","last_undegraded":"2024-06-13T11:37:12.819177+0000","last_fullsized":"2024-06-13T11:37:12.819177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:43.551508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152587+0000","last_change":"2024-06-13T11:37:07.822417+0000","last_active":"2024-06-13T11:37:13.152587+0000","last_peered":"2024-06-13T11:37:13.152587+0000","last_clean":"2024-06-13T11:37:13.152587+0000","last_became_active":"2024-06-13T11:37:07.822089+0000","last_became_peered":"2024-06-13T11:37:07.822089+0000","last_unstale":"2024-06-13T11:37:13.152587+0000","last_undegraded":"2024-06-13T11:37:13.152587+0000","last_fullsized":"2024-06-13T11:37:13.152587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712075+0000","last_change":"2024-06-13T11:37:06.785156+0000","last_active":"2024-06-13T11:37:13.712075+0000","last_peered":"2024-06-13T11:37:13.712075+0000","last_clean":"2024-06-13T11:37:13.712075+0000","last_became_active":"2024-06-13T11:37:06.784829+0000","last_became_peered":"2024-06-13T11:37:06.784829+0000","last_unstale":"2024-06-13T11:37:13.712075+0000","last_undegraded":"2024-06-13T11:37:13.712075+0000","last_fullsized":"2024-06-13T11:37:13.712075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712893+0000","last_change":"2024-06-13T11:37:11.838670+0000","last_active":"2024-06-13T11:37:13.712893+0000","last_peered":"2024-06-13T11:37:13.712893+0000","last_clean":"2024-06-13T11:37:13.712893+0000","last_became_active":"2024-06-13T11:37:11.838262+0000","last_became_peered":"2024-06-13T11:37:11.838262+0000","last_unstale":"2024-06-13T11:37:13.712893+0000","last_undegraded":"2024-06-13T11:37:13.712893+0000","last_fullsized":"2024-06-13T11:37:13.712893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:17.899945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820178+0000","last_change":"2024-06-13T11:37:07.816286+0000","last_active":"2024-06-13T11:37:12.820178+0000","last_peered":"2024-06-13T11:37:12.820178+0000","last_clean":"2024-06-13T11:37:12.820178+0000","last_became_active":"2024-06-13T11:37:07.815777+0000","last_became_peered":"2024-06-13T11:37:07.815777+0000","last_unstale":"2024-06-13T11:37:12.820178+0000","last_undegraded":"2024-06-13T11:37:12.820178+0000","last_fullsized":"2024-06-13T11:37:12.820178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820785+0000","last_change":"2024-06-13T11:37:06.789763+0000","last_active":"2024-06-13T11:37:12.820785+0000","last_peered":"2024-06-13T11:37:12.820785+0000","last_clean":"2024-06-13T11:37:12.820785+0000","last_became_active":"2024-06-13T11:37:06.789419+0000","last_became_peered":"2024-06-13T11:37:06.789419+0000","last_unstale":"2024-06-13T11:37:12.820785+0000","last_undegraded":"2024-06-13T11:37:12.820785+0000","last_fullsized":"2024-06-13T11:37:12.820785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714261+0000","last_change":"2024-06-13T11:37:12.059420+0000","last_active":"2024-06-13T11:37:13.714261+0000","last_peered":"2024-06-13T11:37:13.714261+0000","last_clean":"2024-06-13T11:37:13.714261+0000","last_became_active":"2024-06-13T11:37:12.059035+0000","last_became_peered":"2024-06-13T11:37:12.059035+0000","last_unstale":"2024-06-13T11:37:13.714261+0000","last_undegraded":"2024-06-13T11:37:13.714261+0000","last_fullsized":"2024-06-13T11:37:13.714261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:47:04.312331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152626+0000","last_change":"2024-06-13T11:37:07.823057+0000","last_active":"2024-06-13T11:37:13.152626+0000","last_peered":"2024-06-13T11:37:13.152626+0000","last_clean":"2024-06-13T11:37:13.152626+0000","last_became_active":"2024-06-13T11:37:07.821414+0000","last_became_peered":"2024-06-13T11:37:07.821414+0000","last_unstale":"2024-06-13T11:37:13.152626+0000","last_undegraded":"2024-06-13T11:37:13.152626+0000","last_fullsized":"2024-06-13T11:37:13.152626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168391+0000","last_change":"2024-06-13T11:37:06.805846+0000","last_active":"2024-06-13T11:37:13.168391+0000","last_peered":"2024-06-13T11:37:13.168391+0000","last_clean":"2024-06-13T11:37:13.168391+0000","last_became_active":"2024-06-13T11:37:06.803100+0000","last_became_peered":"2024-06-13T11:37:06.803100+0000","last_unstale":"2024-06-13T11:37:13.168391+0000","last_undegraded":"2024-06-13T11:37:13.168391+0000","last_fullsized":"2024-06-13T11:37:13.168391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:36.725938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714058+0000","last_change":"2024-06-13T11:37:12.055700+0000","last_active":"2024-06-13T11:37:13.714058+0000","last_peered":"2024-06-13T11:37:13.714058+0000","last_clean":"2024-06-13T11:37:13.714058+0000","last_became_active":"2024-06-13T11:37:12.055159+0000","last_became_peered":"2024-06-13T11:37:12.055159+0000","last_unstale":"2024-06-13T11:37:13.714058+0000","last_undegraded":"2024-06-13T11:37:13.714058+0000","last_fullsized":"2024-06-13T11:37:13.714058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:55:00.012631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713171+0000","last_change":"2024-06-13T11:37:07.806718+0000","last_active":"2024-06-13T11:37:13.713171+0000","last_peered":"2024-06-13T11:37:13.713171+0000","last_clean":"2024-06-13T11:37:13.713171+0000","last_became_active":"2024-06-13T11:37:07.806243+0000","last_became_peered":"2024-06-13T11:37:07.806243+0000","last_unstale":"2024-06-13T11:37:13.713171+0000","last_undegraded":"2024-06-13T11:37:13.713171+0000","last_fullsized":"2024-06-13T11:37:13.713171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:44:45.438582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713668+0000","last_change":"2024-06-13T11:37:06.798091+0000","last_active":"2024-06-13T11:37:13.713668+0000","last_peered":"2024-06-13T11:37:13.713668+0000","last_clean":"2024-06-13T11:37:13.713668+0000","last_became_active":"2024-06-13T11:37:06.797712+0000","last_became_peered":"2024-06-13T11:37:06.797712+0000","last_unstale":"2024-06-13T11:37:13.713668+0000","last_undegraded":"2024-06-13T11:37:13.713668+0000","last_fullsized":"2024-06-13T11:37:13.713668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168678+0000","last_change":"2024-06-13T11:37:12.056862+0000","last_active":"2024-06-13T11:37:13.168678+0000","last_peered":"2024-06-13T11:37:13.168678+0000","last_clean":"2024-06-13T11:37:13.168678+0000","last_became_active":"2024-06-13T11:37:12.056394+0000","last_became_peered":"2024-06-13T11:37:12.056394+0000","last_unstale":"2024-06-13T11:37:13.168678+0000","last_undegraded":"2024-06-13T11:37:13.168678+0000","last_fullsized":"2024-06-13T11:37:13.168678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:30:32.045207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152808+0000","last_change":"2024-06-13T11:37:07.816795+0000","last_active":"2024-06-13T11:37:13.152808+0000","last_peered":"2024-06-13T11:37:13.152808+0000","last_clean":"2024-06-13T11:37:13.152808+0000","last_became_active":"2024-06-13T11:37:07.816480+0000","last_became_peered":"2024-06-13T11:37:07.816480+0000","last_unstale":"2024-06-13T11:37:13.152808+0000","last_undegraded":"2024-06-13T11:37:13.152808+0000","last_fullsized":"2024-06-13T11:37:13.152808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:17.399783+0000","last_change":"2024-06-13T11:37:06.793664+0000","last_active":"2024-06-13T11:37:17.399783+0000","last_peered":"2024-06-13T11:37:17.399783+0000","last_clean":"2024-06-13T11:37:17.399783+0000","last_became_active":"2024-06-13T11:37:06.793399+0000","last_became_peered":"2024-06-13T11:37:06.793399+0000","last_unstale":"2024-06-13T11:37:17.399783+0000","last_undegraded":"2024-06-13T11:37:17.399783+0000","last_fullsized":"2024-06-13T11:37:17.399783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819864+0000","last_change":"2024-06-13T11:37:11.840940+0000","last_active":"2024-06-13T11:37:12.819864+0000","last_peered":"2024-06-13T11:37:12.819864+0000","last_clean":"2024-06-13T11:37:12.819864+0000","last_became_active":"2024-06-13T11:37:11.840527+0000","last_became_peered":"2024-06-13T11:37:11.840527+0000","last_unstale":"2024-06-13T11:37:12.819864+0000","last_undegraded":"2024-06-13T11:37:12.819864+0000","last_fullsized":"2024-06-13T11:37:12.819864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821244+0000","last_change":"2024-06-13T11:37:07.810016+0000","last_active":"2024-06-13T11:37:12.821244+0000","last_peered":"2024-06-13T11:37:12.821244+0000","last_clean":"2024-06-13T11:37:12.821244+0000","last_became_active":"2024-06-13T11:37:07.809754+0000","last_became_peered":"2024-06-13T11:37:07.809754+0000","last_unstale":"2024-06-13T11:37:12.821244+0000","last_undegraded":"2024-06-13T11:37:12.821244+0000","last_fullsized":"2024-06-13T11:37:12.821244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:13.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820199+0000","last_change":"2024-06-13T11:37:06.802832+0000","last_active":"2024-06-13T11:37:12.820199+0000","last_peered":"2024-06-13T11:37:12.820199+0000","last_clean":"2024-06-13T11:37:12.820199+0000","last_became_active":"2024-06-13T11:37:06.802502+0000","last_became_peered":"2024-06-13T11:37:06.802502+0000","last_unstale":"2024-06-13T11:37:12.820199+0000","last_undegraded":"2024-06-13T11:37:12.820199+0000","last_fullsized":"2024-06-13T11:37:12.820199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819861+0000","last_change":"2024-06-13T11:37:11.842063+0000","last_active":"2024-06-13T11:37:12.819861+0000","last_peered":"2024-06-13T11:37:12.819861+0000","last_clean":"2024-06-13T11:37:12.819861+0000","last_became_active":"2024-06-13T11:37:11.841560+0000","last_became_peered":"2024-06-13T11:37:11.841560+0000","last_unstale":"2024-06-13T11:37:12.819861+0000","last_undegraded":"2024-06-13T11:37:12.819861+0000","last_fullsized":"2024-06-13T11:37:12.819861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:51.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713089+0000","last_change":"2024-06-13T11:37:07.816725+0000","last_active":"2024-06-13T11:37:13.713089+0000","last_peered":"2024-06-13T11:37:13.713089+0000","last_clean":"2024-06-13T11:37:13.713089+0000","last_became_active":"2024-06-13T11:37:07.816381+0000","last_became_peered":"2024-06-13T11:37:07.816381+0000","last_unstale":"2024-06-13T11:37:13.713089+0000","last_undegraded":"2024-06-13T11:37:13.713089+0000","last_fullsized":"2024-06-13T11:37:13.713089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168737+0000","last_change":"2024-06-13T11:37:06.804917+0000","last_active":"2024-06-13T11:37:13.168737+0000","last_peered":"2024-06-13T11:37:13.168737+0000","last_clean":"2024-06-13T11:37:13.168737+0000","last_became_active":"2024-06-13T11:37:06.804193+0000","last_became_peered":"2024-06-13T11:37:06.804193+0000","last_unstale":"2024-06-13T11:37:13.168737+0000","last_undegraded":"2024-06-13T11:37:13.168737+0000","last_fullsized":"2024-06-13T11:37:13.168737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:28.538858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712516+0000","last_change":"2024-06-13T11:37:11.842840+0000","last_active":"2024-06-13T11:37:13.712516+0000","last_peered":"2024-06-13T11:37:13.712516+0000","last_clean":"2024-06-13T11:37:13.712516+0000","last_became_active":"2024-06-13T11:37:11.842012+0000","last_became_peered":"2024-06-13T11:37:11.842012+0000","last_unstale":"2024-06-13T11:37:13.712516+0000","last_undegraded":"2024-06-13T11:37:13.712516+0000","last_fullsized":"2024-06-13T11:37:13.712516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:55.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168668+0000","last_change":"2024-06-13T11:37:07.814121+0000","last_active":"2024-06-13T11:37:13.168668+0000","last_peered":"2024-06-13T11:37:13.168668+0000","last_clean":"2024-06-13T11:37:13.168668+0000","last_became_active":"2024-06-13T11:37:07.813843+0000","last_became_peered":"2024-06-13T11:37:07.813843+0000","last_unstale":"2024-06-13T11:37:13.168668+0000","last_undegraded":"2024-06-13T11:37:13.168668+0000","last_fullsized":"2024-06-13T11:37:13.168668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821122+0000","last_change":"2024-06-13T11:37:06.803877+0000","last_active":"2024-06-13T11:37:12.821122+0000","last_peered":"2024-06-13T11:37:12.821122+0000","last_clean":"2024-06-13T11:37:12.821122+0000","last_became_active":"2024-06-13T11:37:06.803562+0000","last_became_peered":"2024-06-13T11:37:06.803562+0000","last_unstale":"2024-06-13T11:37:12.821122+0000","last_undegraded":"2024-06-13T11:37:12.821122+0000","last_fullsized":"2024-06-13T11:37:12.821122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713551+0000","last_change":"2024-06-13T11:37:12.055863+0000","last_active":"2024-06-13T11:37:13.713551+0000","last_peered":"2024-06-13T11:37:13.713551+0000","last_clean":"2024-06-13T11:37:13.713551+0000","last_became_active":"2024-06-13T11:37:12.055240+0000","last_became_peered":"2024-06-13T11:37:12.055240+0000","last_unstale":"2024-06-13T11:37:13.713551+0000","last_undegraded":"2024-06-13T11:37:13.713551+0000","last_fullsized":"2024-06-13T11:37:13.713551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:00.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712723+0000","last_change":"2024-06-13T11:37:12.059446+0000","last_active":"2024-06-13T11:37:13.712723+0000","last_peered":"2024-06-13T11:37:13.712723+0000","last_clean":"2024-06-13T11:37:13.712723+0000","last_became_active":"2024-06-13T11:37:12.057697+0000","last_became_peered":"2024-06-13T11:37:12.057697+0000","last_unstale":"2024-06-13T11:37:13.712723+0000","last_undegraded":"2024-06-13T11:37:13.712723+0000","last_fullsized":"2024-06-13T11:37:13.712723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819164+0000","last_change":"2024-06-13T11:37:07.814989+0000","last_active":"2024-06-13T11:37:12.819164+0000","last_peered":"2024-06-13T11:37:12.819164+0000","last_clean":"2024-06-13T11:37:12.819164+0000","last_became_active":"2024-06-13T11:37:07.814564+0000","last_became_peered":"2024-06-13T11:37:07.814564+0000","last_unstale":"2024-06-13T11:37:12.819164+0000","last_undegraded":"2024-06-13T11:37:12.819164+0000","last_fullsized":"2024-06-13T11:37:12.819164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168310+0000","last_change":"2024-06-13T11:37:06.802741+0000","last_active":"2024-06-13T11:37:13.168310+0000","last_peered":"2024-06-13T11:37:13.168310+0000","last_clean":"2024-06-13T11:37:13.168310+0000","last_became_active":"2024-06-13T11:37:06.802409+0000","last_became_peered":"2024-06-13T11:37:06.802409+0000","last_unstale":"2024-06-13T11:37:13.168310+0000","last_undegraded":"2024-06-13T11:37:13.168310+0000","last_fullsized":"2024-06-13T11:37:13.168310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:05:54.761290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819943+0000","last_change":"2024-06-13T11:37:11.841003+0000","last_active":"2024-06-13T11:37:12.819943+0000","last_peered":"2024-06-13T11:37:12.819943+0000","last_clean":"2024-06-13T11:37:12.819943+0000","last_became_active":"2024-06-13T11:37:11.840537+0000","last_became_peered":"2024-06-13T11:37:11.840537+0000","last_unstale":"2024-06-13T11:37:12.819943+0000","last_undegraded":"2024-06-13T11:37:12.819943+0000","last_fullsized":"2024-06-13T11:37:12.819943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:16:14.249413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712613+0000","last_change":"2024-06-13T11:37:07.814236+0000","last_active":"2024-06-13T11:37:13.712613+0000","last_peered":"2024-06-13T11:37:13.712613+0000","last_clean":"2024-06-13T11:37:13.712613+0000","last_became_active":"2024-06-13T11:37:07.813951+0000","last_became_peered":"2024-06-13T11:37:07.813951+0000","last_unstale":"2024-06-13T11:37:13.712613+0000","last_undegraded":"2024-06-13T11:37:13.712613+0000","last_fullsized":"2024-06-13T11:37:13.712613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713871+0000","last_change":"2024-06-13T11:37:06.793599+0000","last_active":"2024-06-13T11:37:13.713871+0000","last_peered":"2024-06-13T11:37:13.713871+0000","last_clean":"2024-06-13T11:37:13.713871+0000","last_became_active":"2024-06-13T11:37:06.793280+0000","last_became_peered":"2024-06-13T11:37:06.793280+0000","last_unstale":"2024-06-13T11:37:13.713871+0000","last_undegraded":"2024-06-13T11:37:13.713871+0000","last_fullsized":"2024-06-13T11:37:13.713871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821282+0000","last_change":"2024-06-13T11:37:06.794432+0000","last_active":"2024-06-13T11:37:12.821282+0000","last_peered":"2024-06-13T11:37:12.821282+0000","last_clean":"2024-06-13T11:37:12.821282+0000","last_became_active":"2024-06-13T11:37:06.794119+0000","last_became_peered":"2024-06-13T11:37:06.794119+0000","last_unstale":"2024-06-13T11:37:12.821282+0000","last_undegraded":"2024-06-13T11:37:12.821282+0000","last_fullsized":"2024-06-13T11:37:12.821282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713576+0000","last_change":"2024-06-13T11:37:07.809910+0000","last_active":"2024-06-13T11:37:13.713576+0000","last_peered":"2024-06-13T11:37:13.713576+0000","last_clean":"2024-06-13T11:37:13.713576+0000","last_became_active":"2024-06-13T11:37:07.809587+0000","last_became_peered":"2024-06-13T11:37:07.809587+0000","last_unstale":"2024-06-13T11:37:13.713576+0000","last_undegraded":"2024-06-13T11:37:13.713576+0000","last_fullsized":"2024-06-13T11:37:13.713576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712785+0000","last_change":"2024-06-13T11:37:11.832051+0000","last_active":"2024-06-13T11:37:13.712785+0000","last_peered":"2024-06-13T11:37:13.712785+0000","last_clean":"2024-06-13T11:37:13.712785+0000","last_became_active":"2024-06-13T11:37:11.831633+0000","last_became_peered":"2024-06-13T11:37:11.831633+0000","last_unstale":"2024-06-13T11:37:13.712785+0000","last_undegraded":"2024-06-13T11:37:13.712785+0000","last_fullsized":"2024-06-13T11:37:13.712785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:03:22.884367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713873+0000","last_change":"2024-06-13T11:37:06.797052+0000","last_active":"2024-06-13T11:37:13.713873+0000","last_peered":"2024-06-13T11:37:13.713873+0000","last_clean":"2024-06-13T11:37:13.713873+0000","last_became_active":"2024-06-13T11:37:06.796723+0000","last_became_peered":"2024-06-13T11:37:06.796723+0000","last_unstale":"2024-06-13T11:37:13.713873+0000","last_undegraded":"2024-06-13T11:37:13.713873+0000","last_fullsized":"2024-06-13T11:37:13.713873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819596+0000","last_change":"2024-06-13T11:37:07.805771+0000","last_active":"2024-06-13T11:37:12.819596+0000","last_peered":"2024-06-13T11:37:12.819596+0000","last_clean":"2024-06-13T11:37:12.819596+0000","last_became_active":"2024-06-13T11:37:07.805463+0000","last_became_peered":"2024-06-13T11:37:07.805463+0000","last_unstale":"2024-06-13T11:37:12.819596+0000","last_undegraded":"2024-06-13T11:37:12.819596+0000","last_fullsized":"2024-06-13T11:37:12.819596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:44.456986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713722+0000","last_change":"2024-06-13T11:37:11.841035+0000","last_active":"2024-06-13T11:37:13.713722+0000","last_peered":"2024-06-13T11:37:13.713722+0000","last_clean":"2024-06-13T11:37:13.713722+0000","last_became_active":"2024-06-13T11:37:11.840626+0000","last_became_peered":"2024-06-13T11:37:11.840626+0000","last_unstale":"2024-06-13T11:37:13.713722+0000","last_undegraded":"2024-06-13T11:37:13.713722+0000","last_fullsized":"2024-06-13T11:37:13.713722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:32:57.521991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820017+0000","last_change":"2024-06-13T11:37:07.816052+0000","last_active":"2024-06-13T11:37:12.820017+0000","last_peered":"2024-06-13T11:37:12.820017+0000","last_clean":"2024-06-13T11:37:12.820017+0000","last_became_active":"2024-06-13T11:37:07.815407+0000","last_became_peered":"2024-06-13T11:37:07.815407+0000","last_unstale":"2024-06-13T11:37:12.820017+0000","last_undegraded":"2024-06-13T11:37:12.820017+0000","last_fullsized":"2024-06-13T11:37:12.820017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712280+0000","last_change":"2024-06-13T11:37:07.813338+0000","last_active":"2024-06-13T11:37:13.712280+0000","last_peered":"2024-06-13T11:37:13.712280+0000","last_clean":"2024-06-13T11:37:13.712280+0000","last_became_active":"2024-06-13T11:37:07.813058+0000","last_became_peered":"2024-06-13T11:37:07.813058+0000","last_unstale":"2024-06-13T11:37:13.712280+0000","last_undegraded":"2024-06-13T11:37:13.712280+0000","last_fullsized":"2024-06-13T11:37:13.712280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:04.020273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168311+0000","last_change":"2024-06-13T11:37:07.814579+0000","last_active":"2024-06-13T11:37:13.168311+0000","last_peered":"2024-06-13T11:37:13.168311+0000","last_clean":"2024-06-13T11:37:13.168311+0000","last_became_active":"2024-06-13T11:37:07.814287+0000","last_became_peered":"2024-06-13T11:37:07.814287+0000","last_unstale":"2024-06-13T11:37:13.168311+0000","last_undegraded":"2024-06-13T11:37:13.168311+0000","last_fullsized":"2024-06-13T11:37:13.168311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713460+0000","last_change":"2024-06-13T11:37:07.812453+0000","last_active":"2024-06-13T11:37:13.713460+0000","last_peered":"2024-06-13T11:37:13.713460+0000","last_clean":"2024-06-13T11:37:13.713460+0000","last_became_active":"2024-06-13T11:37:07.812179+0000","last_became_peered":"2024-06-13T11:37:07.812179+0000","last_unstale":"2024-06-13T11:37:13.713460+0000","last_undegraded":"2024-06-13T11:37:13.713460+0000","last_fullsized":"2024-06-13T11:37:13.713460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714168+0000","last_change":"2024-06-13T11:37:07.809534+0000","last_active":"2024-06-13T11:37:13.714168+0000","last_peered":"2024-06-13T11:37:13.714168+0000","last_clean":"2024-06-13T11:37:13.714168+0000","last_became_active":"2024-06-13T11:37:07.809238+0000","last_became_peered":"2024-06-13T11:37:07.809238+0000","last_unstale":"2024-06-13T11:37:13.714168+0000","last_undegraded":"2024-06-13T11:37:13.714168+0000","last_fullsized":"2024-06-13T11:37:13.714168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:16:41.866755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819893+0000","last_change":"2024-06-13T11:37:07.818257+0000","last_active":"2024-06-13T11:37:12.819893+0000","last_peered":"2024-06-13T11:37:12.819893+0000","last_clean":"2024-06-13T11:37:12.819893+0000","last_became_active":"2024-06-13T11:37:07.817910+0000","last_became_peered":"2024-06-13T11:37:07.817910+0000","last_unstale":"2024-06-13T11:37:12.819893+0000","last_undegraded":"2024-06-13T11:37:12.819893+0000","last_fullsized":"2024-06-13T11:37:12.819893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821518+0000","last_change":"2024-06-13T11:37:07.810465+0000","last_active":"2024-06-13T11:37:12.821518+0000","last_peered":"2024-06-13T11:37:12.821518+0000","last_clean":"2024-06-13T11:37:12.821518+0000","last_became_active":"2024-06-13T11:37:07.810018+0000","last_became_peered":"2024-06-13T11:37:07.810018+0000","last_unstale":"2024-06-13T11:37:12.821518+0000","last_undegraded":"2024-06-13T11:37:12.821518+0000","last_fullsized":"2024-06-13T11:37:12.821518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714221+0000","last_change":"2024-06-13T11:37:07.807899+0000","last_active":"2024-06-13T11:37:13.714221+0000","last_peered":"2024-06-13T11:37:13.714221+0000","last_clean":"2024-06-13T11:37:13.714221+0000","last_became_active":"2024-06-13T11:37:07.807583+0000","last_became_peered":"2024-06-13T11:37:07.807583+0000","last_unstale":"2024-06-13T11:37:13.714221+0000","last_undegraded":"2024-06-13T11:37:13.714221+0000","last_fullsized":"2024-06-13T11:37:13.714221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:11.241283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168187+0000","last_change":"2024-06-13T11:37:07.803581+0000","last_active":"2024-06-13T11:37:13.168187+0000","last_peered":"2024-06-13T11:37:13.168187+0000","last_clean":"2024-06-13T11:37:13.168187+0000","last_became_active":"2024-06-13T11:37:07.803152+0000","last_became_peered":"2024-06-13T11:37:07.803152+0000","last_unstale":"2024-06-13T11:37:13.168187+0000","last_undegraded":"2024-06-13T11:37:13.168187+0000","last_fullsized":"2024-06-13T11:37:13.168187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713706+0000","last_change":"2024-06-13T11:37:07.805036+0000","last_active":"2024-06-13T11:37:13.713706+0000","last_peered":"2024-06-13T11:37:13.713706+0000","last_clean":"2024-06-13T11:37:13.713706+0000","last_became_active":"2024-06-13T11:37:07.804074+0000","last_became_peered":"2024-06-13T11:37:07.804074+0000","last_unstale":"2024-06-13T11:37:13.713706+0000","last_undegraded":"2024-06-13T11:37:13.713706+0000","last_fullsized":"2024-06-13T11:37:13.713706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:32:19.911394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168271+0000","last_change":"2024-06-13T11:37:07.822794+0000","last_active":"2024-06-13T11:37:13.168271+0000","last_peered":"2024-06-13T11:37:13.168271+0000","last_clean":"2024-06-13T11:37:13.168271+0000","last_became_active":"2024-06-13T11:37:07.822476+0000","last_became_peered":"2024-06-13T11:37:07.822476+0000","last_unstale":"2024-06-13T11:37:13.168271+0000","last_undegraded":"2024-06-13T11:37:13.168271+0000","last_fullsized":"2024-06-13T11:37:13.168271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713222+0000","last_change":"2024-06-13T11:37:07.810639+0000","last_active":"2024-06-13T11:37:13.713222+0000","last_peered":"2024-06-13T11:37:13.713222+0000","last_clean":"2024-06-13T11:37:13.713222+0000","last_became_active":"2024-06-13T11:37:07.810285+0000","last_became_peered":"2024-06-13T11:37:07.810285+0000","last_unstale":"2024-06-13T11:37:13.713222+0000","last_undegraded":"2024-06-13T11:37:13.713222+0000","last_fullsized":"2024-06-13T11:37:13.713222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821000+0000","last_change":"2024-06-13T11:37:07.804880+0000","last_active":"2024-06-13T11:37:12.821000+0000","last_peered":"2024-06-13T11:37:12.821000+0000","last_clean":"2024-06-13T11:37:12.821000+0000","last_became_active":"2024-06-13T11:37:07.803451+0000","last_became_peered":"2024-06-13T11:37:07.803451+0000","last_unstale":"2024-06-13T11:37:12.821000+0000","last_undegraded":"2024-06-13T11:37:12.821000+0000","last_fullsized":"2024-06-13T11:37:12.821000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153125+0000","last_change":"2024-06-13T11:37:07.808713+0000","last_active":"2024-06-13T11:37:13.153125+0000","last_peered":"2024-06-13T11:37:13.153125+0000","last_clean":"2024-06-13T11:37:13.153125+0000","last_became_active":"2024-06-13T11:37:07.808422+0000","last_became_peered":"2024-06-13T11:37:07.808422+0000","last_unstale":"2024-06-13T11:37:13.153125+0000","last_undegraded":"2024-06-13T11:37:13.153125+0000","last_fullsized":"2024-06-13T11:37:13.153125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712358+0000","last_change":"2024-06-13T11:37:07.808193+0000","last_active":"2024-06-13T11:37:13.712358+0000","last_peered":"2024-06-13T11:37:13.712358+0000","last_clean":"2024-06-13T11:37:13.712358+0000","last_became_active":"2024-06-13T11:37:07.807809+0000","last_became_peered":"2024-06-13T11:37:07.807809+0000","last_unstale":"2024-06-13T11:37:13.712358+0000","last_undegraded":"2024-06-13T11:37:13.712358+0000","last_fullsized":"2024-06-13T11:37:13.712358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:08.966864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168884+0000","last_change":"2024-06-13T11:37:07.826457+0000","last_active":"2024-06-13T11:37:13.168884+0000","last_peered":"2024-06-13T11:37:13.168884+0000","last_clean":"2024-06-13T11:37:13.168884+0000","last_became_active":"2024-06-13T11:37:07.826150+0000","last_became_peered":"2024-06-13T11:37:07.826150+0000","last_unstale":"2024-06-13T11:37:13.168884+0000","last_undegraded":"2024-06-13T11:37:13.168884+0000","last_fullsized":"2024-06-13T11:37:13.168884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168030+0000","last_change":"2024-06-13T11:37:07.817291+0000","last_active":"2024-06-13T11:37:13.168030+0000","last_peered":"2024-06-13T11:37:13.168030+0000","last_clean":"2024-06-13T11:37:13.168030+0000","last_became_active":"2024-06-13T11:37:07.817016+0000","last_became_peered":"2024-06-13T11:37:07.817016+0000","last_unstale":"2024-06-13T11:37:13.168030+0000","last_undegraded":"2024-06-13T11:37:13.168030+0000","last_fullsized":"2024-06-13T11:37:13.168030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:10.222966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819296+0000","last_change":"2024-06-13T11:37:07.807833+0000","last_active":"2024-06-13T11:37:12.819296+0000","last_peered":"2024-06-13T11:37:12.819296+0000","last_clean":"2024-06-13T11:37:12.819296+0000","last_became_active":"2024-06-13T11:37:07.807536+0000","last_became_peered":"2024-06-13T11:37:07.807536+0000","last_unstale":"2024-06-13T11:37:12.819296+0000","last_undegraded":"2024-06-13T11:37:12.819296+0000","last_fullsized":"2024-06-13T11:37:12.819296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713077+0000","last_change":"2024-06-13T11:37:07.809789+0000","last_active":"2024-06-13T11:37:13.713077+0000","last_peered":"2024-06-13T11:37:13.713077+0000","last_clean":"2024-06-13T11:37:13.713077+0000","last_became_active":"2024-06-13T11:37:07.809493+0000","last_became_peered":"2024-06-13T11:37:07.809493+0000","last_unstale":"2024-06-13T11:37:13.713077+0000","last_undegraded":"2024-06-13T11:37:13.713077+0000","last_fullsized":"2024-06-13T11:37:13.713077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:00.616643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713659+0000","last_change":"2024-06-13T11:37:07.808038+0000","last_active":"2024-06-13T11:37:13.713659+0000","last_peered":"2024-06-13T11:37:13.713659+0000","last_clean":"2024-06-13T11:37:13.713659+0000","last_became_active":"2024-06-13T11:37:07.807727+0000","last_became_peered":"2024-06-13T11:37:07.807727+0000","last_unstale":"2024-06-13T11:37:13.713659+0000","last_undegraded":"2024-06-13T11:37:13.713659+0000","last_fullsized":"2024-06-13T11:37:13.713659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821132+0000","last_change":"2024-06-13T11:37:07.807879+0000","last_active":"2024-06-13T11:37:12.821132+0000","last_peered":"2024-06-13T11:37:12.821132+0000","last_clean":"2024-06-13T11:37:12.821132+0000","last_became_active":"2024-06-13T11:37:07.807538+0000","last_became_peered":"2024-06-13T11:37:07.807538+0000","last_unstale":"2024-06-13T11:37:12.821132+0000","last_undegraded":"2024-06-13T11:37:12.821132+0000","last_fullsized":"2024-06-13T11:37:12.821132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:33.935198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821182+0000","last_change":"2024-06-13T11:37:07.809717+0000","last_active":"2024-06-13T11:37:12.821182+0000","last_peered":"2024-06-13T11:37:12.821182+0000","last_clean":"2024-06-13T11:37:12.821182+0000","last_became_active":"2024-06-13T11:37:07.809444+0000","last_became_peered":"2024-06-13T11:37:07.809444+0000","last_unstale":"2024-06-13T11:37:12.821182+0000","last_undegraded":"2024-06-13T11:37:12.821182+0000","last_fullsized":"2024-06-13T11:37:12.821182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821499+0000","last_change":"2024-06-13T11:37:07.810594+0000","last_active":"2024-06-13T11:37:12.821499+0000","last_peered":"2024-06-13T11:37:12.821499+0000","last_clean":"2024-06-13T11:37:12.821499+0000","last_became_active":"2024-06-13T11:37:07.810177+0000","last_became_peered":"2024-06-13T11:37:07.810177+0000","last_unstale":"2024-06-13T11:37:12.821499+0000","last_undegraded":"2024-06-13T11:37:12.821499+0000","last_fullsized":"2024-06-13T11:37:12.821499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153218+0000","last_change":"2024-06-13T11:37:07.824727+0000","last_active":"2024-06-13T11:37:13.153218+0000","last_peered":"2024-06-13T11:37:13.153218+0000","last_clean":"2024-06-13T11:37:13.153218+0000","last_became_active":"2024-06-13T11:37:07.824440+0000","last_became_peered":"2024-06-13T11:37:07.824440+0000","last_unstale":"2024-06-13T11:37:13.153218+0000","last_undegraded":"2024-06-13T11:37:13.153218+0000","last_fullsized":"2024-06-13T11:37:13.153218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712370+0000","last_change":"2024-06-13T11:37:07.811181+0000","last_active":"2024-06-13T11:37:13.712370+0000","last_peered":"2024-06-13T11:37:13.712370+0000","last_clean":"2024-06-13T11:37:13.712370+0000","last_became_active":"2024-06-13T11:37:07.810827+0000","last_became_peered":"2024-06-13T11:37:07.810827+0000","last_unstale":"2024-06-13T11:37:13.712370+0000","last_undegraded":"2024-06-13T11:37:13.712370+0000","last_fullsized":"2024-06-13T11:37:13.712370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152419+0000","last_change":"2024-06-13T11:37:07.817006+0000","last_active":"2024-06-13T11:37:13.152419+0000","last_peered":"2024-06-13T11:37:13.152419+0000","last_clean":"2024-06-13T11:37:13.152419+0000","last_became_active":"2024-06-13T11:37:07.816608+0000","last_became_peered":"2024-06-13T11:37:07.816608+0000","last_unstale":"2024-06-13T11:37:13.152419+0000","last_undegraded":"2024-06-13T11:37:13.152419+0000","last_fullsized":"2024-06-13T11:37:13.152419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168151+0000","last_change":"2024-06-13T11:37:07.816639+0000","last_active":"2024-06-13T11:37:13.168151+0000","last_peered":"2024-06-13T11:37:13.168151+0000","last_clean":"2024-06-13T11:37:13.168151+0000","last_became_active":"2024-06-13T11:37:07.816347+0000","last_became_peered":"2024-06-13T11:37:07.816347+0000","last_unstale":"2024-06-13T11:37:13.168151+0000","last_undegraded":"2024-06-13T11:37:13.168151+0000","last_fullsized":"2024-06-13T11:37:13.168151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:28:30.350625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152445+0000","last_change":"2024-06-13T11:37:07.818920+0000","last_active":"2024-06-13T11:37:13.152445+0000","last_peered":"2024-06-13T11:37:13.152445+0000","last_clean":"2024-06-13T11:37:13.152445+0000","last_became_active":"2024-06-13T11:37:07.818628+0000","last_became_peered":"2024-06-13T11:37:07.818628+0000","last_unstale":"2024-06-13T11:37:13.152445+0000","last_undegraded":"2024-06-13T11:37:13.152445+0000","last_fullsized":"2024-06-13T11:37:13.152445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168341+0000","last_change":"2024-06-13T11:37:07.812235+0000","last_active":"2024-06-13T11:37:13.168341+0000","last_peered":"2024-06-13T11:37:13.168341+0000","last_clean":"2024-06-13T11:37:13.168341+0000","last_became_active":"2024-06-13T11:37:07.811740+0000","last_became_peered":"2024-06-13T11:37:07.811740+0000","last_unstale":"2024-06-13T11:37:13.168341+0000","last_undegraded":"2024-06-13T11:37:13.168341+0000","last_fullsized":"2024-06-13T11:37:13.168341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:24:14.572925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712830+0000","last_change":"2024-06-13T11:37:07.810203+0000","last_active":"2024-06-13T11:37:13.712830+0000","last_peered":"2024-06-13T11:37:13.712830+0000","last_clean":"2024-06-13T11:37:13.712830+0000","last_became_active":"2024-06-13T11:37:07.809607+0000","last_became_peered":"2024-06-13T11:37:07.809607+0000","last_unstale":"2024-06-13T11:37:13.712830+0000","last_undegraded":"2024-06-13T11:37:13.712830+0000","last_fullsized":"2024-06-13T11:37:13.712830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820323+0000","last_change":"2024-06-13T11:37:07.815528+0000","last_active":"2024-06-13T11:37:12.820323+0000","last_peered":"2024-06-13T11:37:12.820323+0000","last_clean":"2024-06-13T11:37:12.820323+0000","last_became_active":"2024-06-13T11:37:07.815240+0000","last_became_peered":"2024-06-13T11:37:07.815240+0000","last_unstale":"2024-06-13T11:37:12.820323+0000","last_undegraded":"2024-06-13T11:37:12.820323+0000","last_fullsized":"2024-06-13T11:37:12.820323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153117+0000","last_change":"2024-06-13T11:37:07.822539+0000","last_active":"2024-06-13T11:37:13.153117+0000","last_peered":"2024-06-13T11:37:13.153117+0000","last_clean":"2024-06-13T11:37:13.153117+0000","last_became_active":"2024-06-13T11:37:07.820878+0000","last_became_peered":"2024-06-13T11:37:07.820878+0000","last_unstale":"2024-06-13T11:37:13.153117+0000","last_undegraded":"2024-06-13T11:37:13.153117+0000","last_fullsized":"2024-06-13T11:37:13.153117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:51.638079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":694641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":103781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":103817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":103691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":103851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":694697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:37:26.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:37:26.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.503+0000 7fec210bd640 1 Processor -- start 2024-06-13T11:37:26.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.503+0000 7fec210bd640 1 -- start start 2024-06-13T11:37:26.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec210bd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fec1c0b6a70 0x7fec1c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec210bd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c0b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec210bd640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c071d50 con 0x7fec1c0b78a0 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec210bd640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fec1c15ef90 con 0x7fec1c0b6a70 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec210bd640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c162a00 con 0x7fec1c162530 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1a59c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fec1c0b78a0 0x7fec1c161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53036/0 (socket says 172.21.15.43:53036) 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1a59c640 1 -- 172.21.15.43:0/3425944189 learned_addr learned my addr 172.21.15.43:0/3425944189 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1ad9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fec1c0b6a70 0x7fec1c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3425944189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 msgr2=0x7fec1c0b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1b59e640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c0b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1ad9d640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c0b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec19d9b640 1 -- 172.21.15.43:0/3425944189 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354502547 0 0) 0x7fec1c071d50 con 0x7fec1c0b78a0 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3425944189 >> v1:172.21.15.43:6789/0 conn(0x7fec1c0b78a0 legacy=0x7fec1c161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3425944189 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c162ce0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.504+0000 7fec1b59e640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:26.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.505+0000 7fec1ad9d640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c15f420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0097a0 tx=0x7fec0c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3eb99b811e97ed server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.505+0000 7fec19d9b640 1 -- 172.21.15.43:0/3425944189 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c037070 con 0x7fec1c0b6a70 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.505+0000 7fec19d9b640 1 -- 172.21.15.43:0/3425944189 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c02ae50 con 0x7fec1c0b6a70 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.505+0000 7fec19d9b640 1 -- 172.21.15.43:0/3425944189 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c032660 con 0x7fec1c0b6a70 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 -- 172.21.15.43:0/3425944189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 msgr2=0x7fec1c15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c15f420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0097a0 tx=0x7fec0c02a100 comp rx=0 tx=0).stop 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 -- 172.21.15.43:0/3425944189 shutdown_connections 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 --2- 172.21.15.43:0/3425944189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c15f420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 -- 172.21.15.43:0/3425944189 >> 172.21.15.43:0/3425944189 conn(0x7fec1c06f110 msgr2=0x7fec1c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 -- 172.21.15.43:0/3425944189 shutdown_connections 2024-06-13T11:37:26.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.506+0000 7fec210bd640 1 -- 172.21.15.43:0/3425944189 wait complete. 2024-06-13T11:37:26.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.507+0000 7fec210bd640 1 Processor -- start 2024-06-13T11:37:26.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.507+0000 7fec210bd640 1 -- start start 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec210bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec210bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c0b78a0 0x7fec1c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec210bd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec210bd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0b6e50 con 0x7fec1c0b6a70 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec210bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c15ec20 con 0x7fec1c0b78a0 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec210bd640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c0b5390 con 0x7fec1c162530 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec1ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec1ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47776/0 (socket says 172.21.15.43:47776) 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3387717187 learned_addr learned my addr 172.21.15.43:0/3387717187 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec1b59e640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec1a59c640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c0b78a0 0x7fec1c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.508+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 msgr2=0x7fec1c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec1ad9d640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c0b78a0 msgr2=0x7fec1c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec1ad9d640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c0b78a0 0x7fec1c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec1ad9d640 1 -- 172.21.15.43:0/3387717187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c15afd0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec1ad9d640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c158cb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec0c035040 tx=0x7fec0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c037040 con 0x7fec1c0b6a70 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c004230 con 0x7fec1c0b6a70 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c15b2b0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c003610 con 0x7fec1c0b6a70 2024-06-13T11:37:26.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.509+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c14a8f0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.510+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c04ffb0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.510+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec0c0037b0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.511+0000 7fec037fe640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fec0806be30 0x7fec0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.511+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fec0c0ac0b0 con 0x7fec1c0b6a70 2024-06-13T11:37:26.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.511+0000 7fec1a59c640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fec0806be30 0x7fec0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.512+0000 7fec1a59c640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fec0806be30 0x7fec0806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0cedb0 tx=0x7fec10007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.516+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fec0c07a840 con 0x7fec1c0b6a70 2024-06-13T11:37:26.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.694+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec1c15dc00 con 0x7fec0806be30 2024-06-13T11:37:26.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.703+0000 7fec037fe640 1 -- 172.21.15.43:0/3387717187 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fec1c15dc00 con 0x7fec0806be30 2024-06-13T11:37:26.705 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:26.707 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:37:26.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fec0806be30 msgr2=0x7fec0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fec0806be30 0x7fec0806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0cedb0 tx=0x7fec10007b50 comp rx=0 tx=0).stop 2024-06-13T11:37:26.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 msgr2=0x7fec1c158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c158cb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec0c035040 tx=0x7fec0c0046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 shutdown_connections 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fec0806be30 0x7fec0806e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fec1c162530 0x7fec1c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c0b78a0 0x7fec1c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 --2- 172.21.15.43:0/3387717187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec1c0b6a70 0x7fec1c158cb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 >> 172.21.15.43:0/3387717187 conn(0x7fec1c06f110 msgr2=0x7fec1c0b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 shutdown_connections 2024-06-13T11:37:26.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.706+0000 7fec210bd640 1 -- 172.21.15.43:0/3387717187 wait complete. 2024-06-13T11:37:26.716 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-06-13T11:37:25.353164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252720,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722000,"statfs":{"total":773094113280,"available":772835328000,"internally_reserved":0,"allocated":3350528,"data_stored":2019542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003178"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713160+0000","last_change":"2024-06-13T11:37:06.802024+0000","last_active":"2024-06-13T11:37:13.713160+0000","last_peered":"2024-06-13T11:37:13.713160+0000","last_clean":"2024-06-13T11:37:13.713160+0000","last_became_active":"2024-06-13T11:37:06.801691+0000","last_became_peered":"2024-06-13T11:37:06.801691+0000","last_unstale":"2024-06-13T11:37:13.713160+0000","last_undegraded":"2024-06-13T11:37:13.713160+0000","last_fullsized":"2024-06-13T11:37:13.713160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713972+0000","last_change":"2024-06-13T11:37:07.811931+0000","last_active":"2024-06-13T11:37:13.713972+0000","last_peered":"2024-06-13T11:37:13.713972+0000","last_clean":"2024-06-13T11:37:13.713972+0000","last_became_active":"2024-06-13T11:37:07.811664+0000","last_became_peered":"2024-06-13T11:37:07.811664+0000","last_unstale":"2024-06-13T11:37:13.713972+0000","last_undegraded":"2024-06-13T11:37:13.713972+0000","last_fullsized":"2024-06-13T11:37:13.713972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713382+0000","last_change":"2024-06-13T11:37:12.056726+0000","last_active":"2024-06-13T11:37:13.713382+0000","last_peered":"2024-06-13T11:37:13.713382+0000","last_clean":"2024-06-13T11:37:13.713382+0000","last_became_active":"2024-06-13T11:37:12.056325+0000","last_became_peered":"2024-06-13T11:37:12.056325+0000","last_unstale":"2024-06-13T11:37:13.713382+0000","last_undegraded":"2024-06-13T11:37:13.713382+0000","last_fullsized":"2024-06-13T11:37:13.713382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.767571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714115+0000","last_change":"2024-06-13T11:37:06.796164+0000","last_active":"2024-06-13T11:37:13.714115+0000","last_peered":"2024-06-13T11:37:13.714115+0000","last_clean":"2024-06-13T11:37:13.714115+0000","last_became_active":"2024-06-13T11:37:06.795879+0000","last_became_peered":"2024-06-13T11:37:06.795879+0000","last_unstale":"2024-06-13T11:37:13.714115+0000","last_undegraded":"2024-06-13T11:37:13.714115+0000","last_fullsized":"2024-06-13T11:37:13.714115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712971+0000","last_change":"2024-06-13T11:37:07.816817+0000","last_active":"2024-06-13T11:37:13.712971+0000","last_peered":"2024-06-13T11:37:13.712971+0000","last_clean":"2024-06-13T11:37:13.712971+0000","last_became_active":"2024-06-13T11:37:07.816501+0000","last_became_peered":"2024-06-13T11:37:07.816501+0000","last_unstale":"2024-06-13T11:37:13.712971+0000","last_undegraded":"2024-06-13T11:37:13.712971+0000","last_fullsized":"2024-06-13T11:37:13.712971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819271+0000","last_change":"2024-06-13T11:37:11.840979+0000","last_active":"2024-06-13T11:37:12.819271+0000","last_peered":"2024-06-13T11:37:12.819271+0000","last_clean":"2024-06-13T11:37:12.819271+0000","last_became_active":"2024-06-13T11:37:11.840530+0000","last_became_peered":"2024-06-13T11:37:11.840530+0000","last_unstale":"2024-06-13T11:37:12.819271+0000","last_undegraded":"2024-06-13T11:37:12.819271+0000","last_fullsized":"2024-06-13T11:37:12.819271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:49.007922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152993+0000","last_change":"2024-06-13T11:37:06.804220+0000","last_active":"2024-06-13T11:37:13.152993+0000","last_peered":"2024-06-13T11:37:13.152993+0000","last_clean":"2024-06-13T11:37:13.152993+0000","last_became_active":"2024-06-13T11:37:06.803905+0000","last_became_peered":"2024-06-13T11:37:06.803905+0000","last_unstale":"2024-06-13T11:37:13.152993+0000","last_undegraded":"2024-06-13T11:37:13.152993+0000","last_fullsized":"2024-06-13T11:37:13.152993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168438+0000","last_change":"2024-06-13T11:37:07.818064+0000","last_active":"2024-06-13T11:37:13.168438+0000","last_peered":"2024-06-13T11:37:13.168438+0000","last_clean":"2024-06-13T11:37:13.168438+0000","last_became_active":"2024-06-13T11:37:07.817790+0000","last_became_peered":"2024-06-13T11:37:07.817790+0000","last_unstale":"2024-06-13T11:37:13.168438+0000","last_undegraded":"2024-06-13T11:37:13.168438+0000","last_fullsized":"2024-06-13T11:37:13.168438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819367+0000","last_change":"2024-06-13T11:37:11.843208+0000","last_active":"2024-06-13T11:37:12.819367+0000","last_peered":"2024-06-13T11:37:12.819367+0000","last_clean":"2024-06-13T11:37:12.819367+0000","last_became_active":"2024-06-13T11:37:11.842808+0000","last_became_peered":"2024-06-13T11:37:11.842808+0000","last_unstale":"2024-06-13T11:37:12.819367+0000","last_undegraded":"2024-06-13T11:37:12.819367+0000","last_fullsized":"2024-06-13T11:37:12.819367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:39.425819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152791+0000","last_change":"2024-06-13T11:37:06.806036+0000","last_active":"2024-06-13T11:37:13.152791+0000","last_peered":"2024-06-13T11:37:13.152791+0000","last_clean":"2024-06-13T11:37:13.152791+0000","last_became_active":"2024-06-13T11:37:06.805633+0000","last_became_peered":"2024-06-13T11:37:06.805633+0000","last_unstale":"2024-06-13T11:37:13.152791+0000","last_undegraded":"2024-06-13T11:37:13.152791+0000","last_fullsized":"2024-06-13T11:37:13.152791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168608+0000","last_change":"2024-06-13T11:37:07.818181+0000","last_active":"2024-06-13T11:37:13.168608+0000","last_peered":"2024-06-13T11:37:13.168608+0000","last_clean":"2024-06-13T11:37:13.168608+0000","last_became_active":"2024-06-13T11:37:07.817838+0000","last_became_peered":"2024-06-13T11:37:07.817838+0000","last_unstale":"2024-06-13T11:37:13.168608+0000","last_undegraded":"2024-06-13T11:37:13.168608+0000","last_fullsized":"2024-06-13T11:37:13.168608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819379+0000","last_change":"2024-06-13T11:37:11.836030+0000","last_active":"2024-06-13T11:37:12.819379+0000","last_peered":"2024-06-13T11:37:12.819379+0000","last_clean":"2024-06-13T11:37:12.819379+0000","last_became_active":"2024-06-13T11:37:11.835623+0000","last_became_peered":"2024-06-13T11:37:11.835623+0000","last_unstale":"2024-06-13T11:37:12.819379+0000","last_undegraded":"2024-06-13T11:37:12.819379+0000","last_fullsized":"2024-06-13T11:37:12.819379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:15.824916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821023+0000","last_change":"2024-06-13T11:37:07.801421+0000","last_active":"2024-06-13T11:37:12.821023+0000","last_peered":"2024-06-13T11:37:12.821023+0000","last_clean":"2024-06-13T11:37:12.821023+0000","last_became_active":"2024-06-13T11:37:07.801091+0000","last_became_peered":"2024-06-13T11:37:07.801091+0000","last_unstale":"2024-06-13T11:37:12.821023+0000","last_undegraded":"2024-06-13T11:37:12.821023+0000","last_fullsized":"2024-06-13T11:37:12.821023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152797+0000","last_change":"2024-06-13T11:37:06.800654+0000","last_active":"2024-06-13T11:37:13.152797+0000","last_peered":"2024-06-13T11:37:13.152797+0000","last_clean":"2024-06-13T11:37:13.152797+0000","last_became_active":"2024-06-13T11:37:06.800354+0000","last_became_peered":"2024-06-13T11:37:06.800354+0000","last_unstale":"2024-06-13T11:37:13.152797+0000","last_undegraded":"2024-06-13T11:37:13.152797+0000","last_fullsized":"2024-06-13T11:37:13.152797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:30.194270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821793+0000","last_change":"2024-06-13T11:37:11.844730+0000","last_active":"2024-06-13T11:37:12.821793+0000","last_peered":"2024-06-13T11:37:12.821793+0000","last_clean":"2024-06-13T11:37:12.821793+0000","last_became_active":"2024-06-13T11:37:11.844339+0000","last_became_peered":"2024-06-13T11:37:11.844339+0000","last_unstale":"2024-06-13T11:37:12.821793+0000","last_undegraded":"2024-06-13T11:37:12.821793+0000","last_fullsized":"2024-06-13T11:37:12.821793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:55.671685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713768+0000","last_change":"2024-06-13T11:37:07.814526+0000","last_active":"2024-06-13T11:37:13.713768+0000","last_peered":"2024-06-13T11:37:13.713768+0000","last_clean":"2024-06-13T11:37:13.713768+0000","last_became_active":"2024-06-13T11:37:07.814074+0000","last_became_peered":"2024-06-13T11:37:07.814074+0000","last_unstale":"2024-06-13T11:37:13.713768+0000","last_undegraded":"2024-06-13T11:37:13.713768+0000","last_fullsized":"2024-06-13T11:37:13.713768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820029+0000","last_change":"2024-06-13T11:37:06.796287+0000","last_active":"2024-06-13T11:37:12.820029+0000","last_peered":"2024-06-13T11:37:12.820029+0000","last_clean":"2024-06-13T11:37:12.820029+0000","last_became_active":"2024-06-13T11:37:06.796000+0000","last_became_peered":"2024-06-13T11:37:06.796000+0000","last_unstale":"2024-06-13T11:37:12.820029+0000","last_undegraded":"2024-06-13T11:37:12.820029+0000","last_fullsized":"2024-06-13T11:37:12.820029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820470+0000","last_change":"2024-06-13T11:37:11.842232+0000","last_active":"2024-06-13T11:37:12.820470+0000","last_peered":"2024-06-13T11:37:12.820470+0000","last_clean":"2024-06-13T11:37:12.820470+0000","last_became_active":"2024-06-13T11:37:11.841627+0000","last_became_peered":"2024-06-13T11:37:11.841627+0000","last_unstale":"2024-06-13T11:37:12.820470+0000","last_undegraded":"2024-06-13T11:37:12.820470+0000","last_fullsized":"2024-06-13T11:37:12.820470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:18.353072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712704+0000","last_change":"2024-06-13T11:37:07.811429+0000","last_active":"2024-06-13T11:37:13.712704+0000","last_peered":"2024-06-13T11:37:13.712704+0000","last_clean":"2024-06-13T11:37:13.712704+0000","last_became_active":"2024-06-13T11:37:07.811115+0000","last_became_peered":"2024-06-13T11:37:07.811115+0000","last_unstale":"2024-06-13T11:37:13.712704+0000","last_undegraded":"2024-06-13T11:37:13.712704+0000","last_fullsized":"2024-06-13T11:37:13.712704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819414+0000","last_change":"2024-06-13T11:37:06.800946+0000","last_active":"2024-06-13T11:37:12.819414+0000","last_peered":"2024-06-13T11:37:12.819414+0000","last_clean":"2024-06-13T11:37:12.819414+0000","last_became_active":"2024-06-13T11:37:06.800694+0000","last_became_peered":"2024-06-13T11:37:06.800694+0000","last_unstale":"2024-06-13T11:37:12.819414+0000","last_undegraded":"2024-06-13T11:37:12.819414+0000","last_fullsized":"2024-06-13T11:37:12.819414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820472+0000","last_change":"2024-06-13T11:37:12.056325+0000","last_active":"2024-06-13T11:37:12.820472+0000","last_peered":"2024-06-13T11:37:12.820472+0000","last_clean":"2024-06-13T11:37:12.820472+0000","last_became_active":"2024-06-13T11:37:12.055942+0000","last_became_peered":"2024-06-13T11:37:12.055942+0000","last_unstale":"2024-06-13T11:37:12.820472+0000","last_undegraded":"2024-06-13T11:37:12.820472+0000","last_fullsized":"2024-06-13T11:37:12.820472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819614+0000","last_change":"2024-06-13T11:37:07.802398+0000","last_active":"2024-06-13T11:37:12.819614+0000","last_peered":"2024-06-13T11:37:12.819614+0000","last_clean":"2024-06-13T11:37:12.819614+0000","last_became_active":"2024-06-13T11:37:07.799881+0000","last_became_peered":"2024-06-13T11:37:07.799881+0000","last_unstale":"2024-06-13T11:37:12.819614+0000","last_undegraded":"2024-06-13T11:37:12.819614+0000","last_fullsized":"2024-06-13T11:37:12.819614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:48.876977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152403+0000","last_change":"2024-06-13T11:37:06.801936+0000","last_active":"2024-06-13T11:37:13.152403+0000","last_peered":"2024-06-13T11:37:13.152403+0000","last_clean":"2024-06-13T11:37:13.152403+0000","last_became_active":"2024-06-13T11:37:06.801627+0000","last_became_peered":"2024-06-13T11:37:06.801627+0000","last_unstale":"2024-06-13T11:37:13.152403+0000","last_undegraded":"2024-06-13T11:37:13.152403+0000","last_fullsized":"2024-06-13T11:37:13.152403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:05:47.872930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821463+0000","last_change":"2024-06-13T11:37:11.842008+0000","last_active":"2024-06-13T11:37:12.821463+0000","last_peered":"2024-06-13T11:37:12.821463+0000","last_clean":"2024-06-13T11:37:12.821463+0000","last_became_active":"2024-06-13T11:37:11.840561+0000","last_became_peered":"2024-06-13T11:37:11.840561+0000","last_unstale":"2024-06-13T11:37:12.821463+0000","last_undegraded":"2024-06-13T11:37:12.821463+0000","last_fullsized":"2024-06-13T11:37:12.821463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:08.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713459+0000","last_change":"2024-06-13T11:37:07.805913+0000","last_active":"2024-06-13T11:37:13.713459+0000","last_peered":"2024-06-13T11:37:13.713459+0000","last_clean":"2024-06-13T11:37:13.713459+0000","last_became_active":"2024-06-13T11:37:07.805604+0000","last_became_peered":"2024-06-13T11:37:07.805604+0000","last_unstale":"2024-06-13T11:37:13.713459+0000","last_undegraded":"2024-06-13T11:37:13.713459+0000","last_fullsized":"2024-06-13T11:37:13.713459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821692+0000","last_change":"2024-06-13T11:37:06.798167+0000","last_active":"2024-06-13T11:37:12.821692+0000","last_peered":"2024-06-13T11:37:12.821692+0000","last_clean":"2024-06-13T11:37:12.821692+0000","last_became_active":"2024-06-13T11:37:06.797830+0000","last_became_peered":"2024-06-13T11:37:06.797830+0000","last_unstale":"2024-06-13T11:37:12.821692+0000","last_undegraded":"2024-06-13T11:37:12.821692+0000","last_fullsized":"2024-06-13T11:37:12.821692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819540+0000","last_change":"2024-06-13T11:37:12.061010+0000","last_active":"2024-06-13T11:37:12.819540+0000","last_peered":"2024-06-13T11:37:12.819540+0000","last_clean":"2024-06-13T11:37:12.819540+0000","last_became_active":"2024-06-13T11:37:12.059153+0000","last_became_peered":"2024-06-13T11:37:12.059153+0000","last_unstale":"2024-06-13T11:37:12.819540+0000","last_undegraded":"2024-06-13T11:37:12.819540+0000","last_fullsized":"2024-06-13T11:37:12.819540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:51.635951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714310+0000","last_change":"2024-06-13T11:37:07.813451+0000","last_active":"2024-06-13T11:37:13.714310+0000","last_peered":"2024-06-13T11:37:13.714310+0000","last_clean":"2024-06-13T11:37:13.714310+0000","last_became_active":"2024-06-13T11:37:07.813139+0000","last_became_peered":"2024-06-13T11:37:07.813139+0000","last_unstale":"2024-06-13T11:37:13.714310+0000","last_undegraded":"2024-06-13T11:37:13.714310+0000","last_fullsized":"2024-06-13T11:37:13.714310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820425+0000","last_change":"2024-06-13T11:37:06.791276+0000","last_active":"2024-06-13T11:37:12.820425+0000","last_peered":"2024-06-13T11:37:12.820425+0000","last_clean":"2024-06-13T11:37:12.820425+0000","last_became_active":"2024-06-13T11:37:06.790984+0000","last_became_peered":"2024-06-13T11:37:06.790984+0000","last_unstale":"2024-06-13T11:37:12.820425+0000","last_undegraded":"2024-06-13T11:37:12.820425+0000","last_fullsized":"2024-06-13T11:37:12.820425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712213+0000","last_change":"2024-06-13T11:37:12.056185+0000","last_active":"2024-06-13T11:37:13.712213+0000","last_peered":"2024-06-13T11:37:13.712213+0000","last_clean":"2024-06-13T11:37:13.712213+0000","last_became_active":"2024-06-13T11:37:12.055801+0000","last_became_peered":"2024-06-13T11:37:12.055801+0000","last_unstale":"2024-06-13T11:37:13.712213+0000","last_undegraded":"2024-06-13T11:37:13.712213+0000","last_fullsized":"2024-06-13T11:37:13.712213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:48:35.821250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820132+0000","last_change":"2024-06-13T11:37:07.806070+0000","last_active":"2024-06-13T11:37:12.820132+0000","last_peered":"2024-06-13T11:37:12.820132+0000","last_clean":"2024-06-13T11:37:12.820132+0000","last_became_active":"2024-06-13T11:37:07.805709+0000","last_became_peered":"2024-06-13T11:37:07.805709+0000","last_unstale":"2024-06-13T11:37:12.820132+0000","last_undegraded":"2024-06-13T11:37:12.820132+0000","last_fullsized":"2024-06-13T11:37:12.820132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153136+0000","last_change":"2024-06-13T11:37:06.802281+0000","last_active":"2024-06-13T11:37:13.153136+0000","last_peered":"2024-06-13T11:37:13.153136+0000","last_clean":"2024-06-13T11:37:13.153136+0000","last_became_active":"2024-06-13T11:37:06.801980+0000","last_became_peered":"2024-06-13T11:37:06.801980+0000","last_unstale":"2024-06-13T11:37:13.153136+0000","last_undegraded":"2024-06-13T11:37:13.153136+0000","last_fullsized":"2024-06-13T11:37:13.153136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:12.291247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713126+0000","last_change":"2024-06-13T11:37:12.058285+0000","last_active":"2024-06-13T11:37:13.713126+0000","last_peered":"2024-06-13T11:37:13.713126+0000","last_clean":"2024-06-13T11:37:13.713126+0000","last_became_active":"2024-06-13T11:37:12.056488+0000","last_became_peered":"2024-06-13T11:37:12.056488+0000","last_unstale":"2024-06-13T11:37:13.713126+0000","last_undegraded":"2024-06-13T11:37:13.713126+0000","last_fullsized":"2024-06-13T11:37:13.713126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168770+0000","last_change":"2024-06-13T11:37:07.819314+0000","last_active":"2024-06-13T11:37:13.168770+0000","last_peered":"2024-06-13T11:37:13.168770+0000","last_clean":"2024-06-13T11:37:13.168770+0000","last_became_active":"2024-06-13T11:37:07.819030+0000","last_became_peered":"2024-06-13T11:37:07.819030+0000","last_unstale":"2024-06-13T11:37:13.168770+0000","last_undegraded":"2024-06-13T11:37:13.168770+0000","last_fullsized":"2024-06-13T11:37:13.168770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820299+0000","last_change":"2024-06-13T11:37:06.793665+0000","last_active":"2024-06-13T11:37:12.820299+0000","last_peered":"2024-06-13T11:37:12.820299+0000","last_clean":"2024-06-13T11:37:12.820299+0000","last_became_active":"2024-06-13T11:37:06.793369+0000","last_became_peered":"2024-06-13T11:37:06.793369+0000","last_unstale":"2024-06-13T11:37:12.820299+0000","last_undegraded":"2024-06-13T11:37:12.820299+0000","last_fullsized":"2024-06-13T11:37:12.820299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819444+0000","last_change":"2024-06-13T11:37:11.840712+0000","last_active":"2024-06-13T11:37:12.819444+0000","last_peered":"2024-06-13T11:37:12.819444+0000","last_clean":"2024-06-13T11:37:12.819444+0000","last_became_active":"2024-06-13T11:37:11.840256+0000","last_became_peered":"2024-06-13T11:37:11.840256+0000","last_unstale":"2024-06-13T11:37:12.819444+0000","last_undegraded":"2024-06-13T11:37:12.819444+0000","last_fullsized":"2024-06-13T11:37:12.819444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820268+0000","last_change":"2024-06-13T11:37:07.814284+0000","last_active":"2024-06-13T11:37:12.820268+0000","last_peered":"2024-06-13T11:37:12.820268+0000","last_clean":"2024-06-13T11:37:12.820268+0000","last_became_active":"2024-06-13T11:37:07.813867+0000","last_became_peered":"2024-06-13T11:37:07.813867+0000","last_unstale":"2024-06-13T11:37:12.820268+0000","last_undegraded":"2024-06-13T11:37:12.820268+0000","last_fullsized":"2024-06-13T11:37:12.820268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:18:31.198317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168467+0000","last_change":"2024-06-13T11:37:06.805668+0000","last_active":"2024-06-13T11:37:13.168467+0000","last_peered":"2024-06-13T11:37:13.168467+0000","last_clean":"2024-06-13T11:37:13.168467+0000","last_became_active":"2024-06-13T11:37:06.803111+0000","last_became_peered":"2024-06-13T11:37:06.803111+0000","last_unstale":"2024-06-13T11:37:13.168467+0000","last_undegraded":"2024-06-13T11:37:13.168467+0000","last_fullsized":"2024-06-13T11:37:13.168467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:43.452939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820285+0000","last_change":"2024-06-13T11:37:11.841192+0000","last_active":"2024-06-13T11:37:12.820285+0000","last_peered":"2024-06-13T11:37:12.820285+0000","last_clean":"2024-06-13T11:37:12.820285+0000","last_became_active":"2024-06-13T11:37:11.840770+0000","last_became_peered":"2024-06-13T11:37:11.840770+0000","last_unstale":"2024-06-13T11:37:12.820285+0000","last_undegraded":"2024-06-13T11:37:12.820285+0000","last_fullsized":"2024-06-13T11:37:12.820285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:36.620349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819312+0000","last_change":"2024-06-13T11:37:07.806798+0000","last_active":"2024-06-13T11:37:12.819312+0000","last_peered":"2024-06-13T11:37:12.819312+0000","last_clean":"2024-06-13T11:37:12.819312+0000","last_became_active":"2024-06-13T11:37:07.806493+0000","last_became_peered":"2024-06-13T11:37:07.806493+0000","last_unstale":"2024-06-13T11:37:12.819312+0000","last_undegraded":"2024-06-13T11:37:12.819312+0000","last_fullsized":"2024-06-13T11:37:12.819312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712371+0000","last_change":"2024-06-13T11:37:06.797307+0000","last_active":"2024-06-13T11:37:13.712371+0000","last_peered":"2024-06-13T11:37:13.712371+0000","last_clean":"2024-06-13T11:37:13.712371+0000","last_became_active":"2024-06-13T11:37:06.796897+0000","last_became_peered":"2024-06-13T11:37:06.796897+0000","last_unstale":"2024-06-13T11:37:13.712371+0000","last_undegraded":"2024-06-13T11:37:13.712371+0000","last_fullsized":"2024-06-13T11:37:13.712371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820560+0000","last_change":"2024-06-13T11:37:11.842116+0000","last_active":"2024-06-13T11:37:12.820560+0000","last_peered":"2024-06-13T11:37:12.820560+0000","last_clean":"2024-06-13T11:37:12.820560+0000","last_became_active":"2024-06-13T11:37:11.841597+0000","last_became_peered":"2024-06-13T11:37:11.841597+0000","last_unstale":"2024-06-13T11:37:12.820560+0000","last_undegraded":"2024-06-13T11:37:12.820560+0000","last_fullsized":"2024-06-13T11:37:12.820560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712832+0000","last_change":"2024-06-13T11:37:07.808451+0000","last_active":"2024-06-13T11:37:13.712832+0000","last_peered":"2024-06-13T11:37:13.712832+0000","last_clean":"2024-06-13T11:37:13.712832+0000","last_became_active":"2024-06-13T11:37:07.808158+0000","last_became_peered":"2024-06-13T11:37:07.808158+0000","last_unstale":"2024-06-13T11:37:13.712832+0000","last_undegraded":"2024-06-13T11:37:13.712832+0000","last_fullsized":"2024-06-13T11:37:13.712832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:06:11.057302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152421+0000","last_change":"2024-06-13T11:37:06.804573+0000","last_active":"2024-06-13T11:37:13.152421+0000","last_peered":"2024-06-13T11:37:13.152421+0000","last_clean":"2024-06-13T11:37:13.152421+0000","last_became_active":"2024-06-13T11:37:06.804222+0000","last_became_peered":"2024-06-13T11:37:06.804222+0000","last_unstale":"2024-06-13T11:37:13.152421+0000","last_undegraded":"2024-06-13T11:37:13.152421+0000","last_fullsized":"2024-06-13T11:37:13.152421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:32.931150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713243+0000","last_change":"2024-06-13T11:37:12.057907+0000","last_active":"2024-06-13T11:37:13.713243+0000","last_peered":"2024-06-13T11:37:13.713243+0000","last_clean":"2024-06-13T11:37:13.713243+0000","last_became_active":"2024-06-13T11:37:12.056975+0000","last_became_peered":"2024-06-13T11:37:12.056975+0000","last_unstale":"2024-06-13T11:37:13.713243+0000","last_undegraded":"2024-06-13T11:37:13.713243+0000","last_fullsized":"2024-06-13T11:37:13.713243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:50:46.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713310+0000","last_change":"2024-06-13T11:37:07.812853+0000","last_active":"2024-06-13T11:37:13.713310+0000","last_peered":"2024-06-13T11:37:13.713310+0000","last_clean":"2024-06-13T11:37:13.713310+0000","last_became_active":"2024-06-13T11:37:07.812292+0000","last_became_peered":"2024-06-13T11:37:07.812292+0000","last_unstale":"2024-06-13T11:37:13.713310+0000","last_undegraded":"2024-06-13T11:37:13.713310+0000","last_fullsized":"2024-06-13T11:37:13.713310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:22.022588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168381+0000","last_change":"2024-06-13T11:37:06.801964+0000","last_active":"2024-06-13T11:37:13.168381+0000","last_peered":"2024-06-13T11:37:13.168381+0000","last_clean":"2024-06-13T11:37:13.168381+0000","last_became_active":"2024-06-13T11:37:06.801593+0000","last_became_peered":"2024-06-13T11:37:06.801593+0000","last_unstale":"2024-06-13T11:37:13.168381+0000","last_undegraded":"2024-06-13T11:37:13.168381+0000","last_fullsized":"2024-06-13T11:37:13.168381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:06.866906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152564+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:13.152564+0000","last_peered":"2024-06-13T11:37:13.152564+0000","last_clean":"2024-06-13T11:37:13.152564+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:13.152564+0000","last_undegraded":"2024-06-13T11:37:13.152564+0000","last_fullsized":"2024-06-13T11:37:13.152564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821546+0000","last_change":"2024-06-13T11:37:12.059771+0000","last_active":"2024-06-13T11:37:12.821546+0000","last_peered":"2024-06-13T11:37:12.821546+0000","last_clean":"2024-06-13T11:37:12.821546+0000","last_became_active":"2024-06-13T11:37:12.059321+0000","last_became_peered":"2024-06-13T11:37:12.059321+0000","last_unstale":"2024-06-13T11:37:12.821546+0000","last_undegraded":"2024-06-13T11:37:12.821546+0000","last_fullsized":"2024-06-13T11:37:12.821546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152859+0000","last_change":"2024-06-13T11:37:07.811589+0000","last_active":"2024-06-13T11:37:13.152859+0000","last_peered":"2024-06-13T11:37:13.152859+0000","last_clean":"2024-06-13T11:37:13.152859+0000","last_became_active":"2024-06-13T11:37:07.809978+0000","last_became_peered":"2024-06-13T11:37:07.809978+0000","last_unstale":"2024-06-13T11:37:13.152859+0000","last_undegraded":"2024-06-13T11:37:13.152859+0000","last_fullsized":"2024-06-13T11:37:13.152859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:11.791310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713015+0000","last_change":"2024-06-13T11:37:06.803922+0000","last_active":"2024-06-13T11:37:13.713015+0000","last_peered":"2024-06-13T11:37:13.713015+0000","last_clean":"2024-06-13T11:37:13.713015+0000","last_became_active":"2024-06-13T11:37:06.803580+0000","last_became_peered":"2024-06-13T11:37:06.803580+0000","last_unstale":"2024-06-13T11:37:13.713015+0000","last_undegraded":"2024-06-13T11:37:13.713015+0000","last_fullsized":"2024-06-13T11:37:13.713015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:17.302083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820954+0000","last_change":"2024-06-13T11:37:12.057052+0000","last_active":"2024-06-13T11:37:12.820954+0000","last_peered":"2024-06-13T11:37:12.820954+0000","last_clean":"2024-06-13T11:37:12.820954+0000","last_became_active":"2024-06-13T11:37:12.056584+0000","last_became_peered":"2024-06-13T11:37:12.056584+0000","last_unstale":"2024-06-13T11:37:12.820954+0000","last_undegraded":"2024-06-13T11:37:12.820954+0000","last_fullsized":"2024-06-13T11:37:12.820954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:02:22.726004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168499+0000","last_change":"2024-06-13T11:37:07.812006+0000","last_active":"2024-06-13T11:37:13.168499+0000","last_peered":"2024-06-13T11:37:13.168499+0000","last_clean":"2024-06-13T11:37:13.168499+0000","last_became_active":"2024-06-13T11:37:07.811291+0000","last_became_peered":"2024-06-13T11:37:07.811291+0000","last_unstale":"2024-06-13T11:37:13.168499+0000","last_undegraded":"2024-06-13T11:37:13.168499+0000","last_fullsized":"2024-06-13T11:37:13.168499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820081+0000","last_change":"2024-06-13T11:37:06.795354+0000","last_active":"2024-06-13T11:37:12.820081+0000","last_peered":"2024-06-13T11:37:12.820081+0000","last_clean":"2024-06-13T11:37:12.820081+0000","last_became_active":"2024-06-13T11:37:06.795061+0000","last_became_peered":"2024-06-13T11:37:06.795061+0000","last_unstale":"2024-06-13T11:37:12.820081+0000","last_undegraded":"2024-06-13T11:37:12.820081+0000","last_fullsized":"2024-06-13T11:37:12.820081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:03.016226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713370+0000","last_change":"2024-06-13T11:37:11.837119+0000","last_active":"2024-06-13T11:37:13.713370+0000","last_peered":"2024-06-13T11:37:13.713370+0000","last_clean":"2024-06-13T11:37:13.713370+0000","last_became_active":"2024-06-13T11:37:11.835585+0000","last_became_peered":"2024-06-13T11:37:11.835585+0000","last_unstale":"2024-06-13T11:37:13.713370+0000","last_undegraded":"2024-06-13T11:37:13.713370+0000","last_fullsized":"2024-06-13T11:37:13.713370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:29.851125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153245+0000","last_change":"2024-06-13T11:37:07.824375+0000","last_active":"2024-06-13T11:37:13.153245+0000","last_peered":"2024-06-13T11:37:13.153245+0000","last_clean":"2024-06-13T11:37:13.153245+0000","last_became_active":"2024-06-13T11:37:07.823632+0000","last_became_peered":"2024-06-13T11:37:07.823632+0000","last_unstale":"2024-06-13T11:37:13.153245+0000","last_undegraded":"2024-06-13T11:37:13.153245+0000","last_fullsized":"2024-06-13T11:37:13.153245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:31:03.309590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712454+0000","last_change":"2024-06-13T11:37:06.795631+0000","last_active":"2024-06-13T11:37:13.712454+0000","last_peered":"2024-06-13T11:37:13.712454+0000","last_clean":"2024-06-13T11:37:13.712454+0000","last_became_active":"2024-06-13T11:37:06.795324+0000","last_became_peered":"2024-06-13T11:37:06.795324+0000","last_unstale":"2024-06-13T11:37:13.712454+0000","last_undegraded":"2024-06-13T11:37:13.712454+0000","last_fullsized":"2024-06-13T11:37:13.712454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168005+0000","last_change":"2024-06-13T11:37:12.057488+0000","last_active":"2024-06-13T11:37:13.168005+0000","last_peered":"2024-06-13T11:37:13.168005+0000","last_clean":"2024-06-13T11:37:13.168005+0000","last_became_active":"2024-06-13T11:37:12.055585+0000","last_became_peered":"2024-06-13T11:37:12.055585+0000","last_unstale":"2024-06-13T11:37:13.168005+0000","last_undegraded":"2024-06-13T11:37:13.168005+0000","last_fullsized":"2024-06-13T11:37:13.168005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:50:00.925587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153108+0000","last_change":"2024-06-13T11:37:07.820932+0000","last_active":"2024-06-13T11:37:13.153108+0000","last_peered":"2024-06-13T11:37:13.153108+0000","last_clean":"2024-06-13T11:37:13.153108+0000","last_became_active":"2024-06-13T11:37:07.820617+0000","last_became_peered":"2024-06-13T11:37:07.820617+0000","last_unstale":"2024-06-13T11:37:13.153108+0000","last_undegraded":"2024-06-13T11:37:13.153108+0000","last_fullsized":"2024-06-13T11:37:13.153108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821493+0000","last_change":"2024-06-13T11:37:06.794223+0000","last_active":"2024-06-13T11:37:12.821493+0000","last_peered":"2024-06-13T11:37:12.821493+0000","last_clean":"2024-06-13T11:37:12.821493+0000","last_became_active":"2024-06-13T11:37:06.793864+0000","last_became_peered":"2024-06-13T11:37:06.793864+0000","last_unstale":"2024-06-13T11:37:12.821493+0000","last_undegraded":"2024-06-13T11:37:12.821493+0000","last_fullsized":"2024-06-13T11:37:12.821493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819177+0000","last_change":"2024-06-13T11:37:11.840914+0000","last_active":"2024-06-13T11:37:12.819177+0000","last_peered":"2024-06-13T11:37:12.819177+0000","last_clean":"2024-06-13T11:37:12.819177+0000","last_became_active":"2024-06-13T11:37:11.840526+0000","last_became_peered":"2024-06-13T11:37:11.840526+0000","last_unstale":"2024-06-13T11:37:12.819177+0000","last_undegraded":"2024-06-13T11:37:12.819177+0000","last_fullsized":"2024-06-13T11:37:12.819177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:43.551508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152587+0000","last_change":"2024-06-13T11:37:07.822417+0000","last_active":"2024-06-13T11:37:13.152587+0000","last_peered":"2024-06-13T11:37:13.152587+0000","last_clean":"2024-06-13T11:37:13.152587+0000","last_became_active":"2024-06-13T11:37:07.822089+0000","last_became_peered":"2024-06-13T11:37:07.822089+0000","last_unstale":"2024-06-13T11:37:13.152587+0000","last_undegraded":"2024-06-13T11:37:13.152587+0000","last_fullsized":"2024-06-13T11:37:13.152587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:39.517902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712075+0000","last_change":"2024-06-13T11:37:06.785156+0000","last_active":"2024-06-13T11:37:13.712075+0000","last_peered":"2024-06-13T11:37:13.712075+0000","last_clean":"2024-06-13T11:37:13.712075+0000","last_became_active":"2024-06-13T11:37:06.784829+0000","last_became_peered":"2024-06-13T11:37:06.784829+0000","last_unstale":"2024-06-13T11:37:13.712075+0000","last_undegraded":"2024-06-13T11:37:13.712075+0000","last_fullsized":"2024-06-13T11:37:13.712075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712893+0000","last_change":"2024-06-13T11:37:11.838670+0000","last_active":"2024-06-13T11:37:13.712893+0000","last_peered":"2024-06-13T11:37:13.712893+0000","last_clean":"2024-06-13T11:37:13.712893+0000","last_became_active":"2024-06-13T11:37:11.838262+0000","last_became_peered":"2024-06-13T11:37:11.838262+0000","last_unstale":"2024-06-13T11:37:13.712893+0000","last_undegraded":"2024-06-13T11:37:13.712893+0000","last_fullsized":"2024-06-13T11:37:13.712893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:17.899945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820178+0000","last_change":"2024-06-13T11:37:07.816286+0000","last_active":"2024-06-13T11:37:12.820178+0000","last_peered":"2024-06-13T11:37:12.820178+0000","last_clean":"2024-06-13T11:37:12.820178+0000","last_became_active":"2024-06-13T11:37:07.815777+0000","last_became_peered":"2024-06-13T11:37:07.815777+0000","last_unstale":"2024-06-13T11:37:12.820178+0000","last_undegraded":"2024-06-13T11:37:12.820178+0000","last_fullsized":"2024-06-13T11:37:12.820178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820785+0000","last_change":"2024-06-13T11:37:06.789763+0000","last_active":"2024-06-13T11:37:12.820785+0000","last_peered":"2024-06-13T11:37:12.820785+0000","last_clean":"2024-06-13T11:37:12.820785+0000","last_became_active":"2024-06-13T11:37:06.789419+0000","last_became_peered":"2024-06-13T11:37:06.789419+0000","last_unstale":"2024-06-13T11:37:12.820785+0000","last_undegraded":"2024-06-13T11:37:12.820785+0000","last_fullsized":"2024-06-13T11:37:12.820785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:11.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714261+0000","last_change":"2024-06-13T11:37:12.059420+0000","last_active":"2024-06-13T11:37:13.714261+0000","last_peered":"2024-06-13T11:37:13.714261+0000","last_clean":"2024-06-13T11:37:13.714261+0000","last_became_active":"2024-06-13T11:37:12.059035+0000","last_became_peered":"2024-06-13T11:37:12.059035+0000","last_unstale":"2024-06-13T11:37:13.714261+0000","last_undegraded":"2024-06-13T11:37:13.714261+0000","last_fullsized":"2024-06-13T11:37:13.714261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:47:04.312331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152626+0000","last_change":"2024-06-13T11:37:07.823057+0000","last_active":"2024-06-13T11:37:13.152626+0000","last_peered":"2024-06-13T11:37:13.152626+0000","last_clean":"2024-06-13T11:37:13.152626+0000","last_became_active":"2024-06-13T11:37:07.821414+0000","last_became_peered":"2024-06-13T11:37:07.821414+0000","last_unstale":"2024-06-13T11:37:13.152626+0000","last_undegraded":"2024-06-13T11:37:13.152626+0000","last_fullsized":"2024-06-13T11:37:13.152626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168391+0000","last_change":"2024-06-13T11:37:06.805846+0000","last_active":"2024-06-13T11:37:13.168391+0000","last_peered":"2024-06-13T11:37:13.168391+0000","last_clean":"2024-06-13T11:37:13.168391+0000","last_became_active":"2024-06-13T11:37:06.803100+0000","last_became_peered":"2024-06-13T11:37:06.803100+0000","last_unstale":"2024-06-13T11:37:13.168391+0000","last_undegraded":"2024-06-13T11:37:13.168391+0000","last_fullsized":"2024-06-13T11:37:13.168391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:36.725938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714058+0000","last_change":"2024-06-13T11:37:12.055700+0000","last_active":"2024-06-13T11:37:13.714058+0000","last_peered":"2024-06-13T11:37:13.714058+0000","last_clean":"2024-06-13T11:37:13.714058+0000","last_became_active":"2024-06-13T11:37:12.055159+0000","last_became_peered":"2024-06-13T11:37:12.055159+0000","last_unstale":"2024-06-13T11:37:13.714058+0000","last_undegraded":"2024-06-13T11:37:13.714058+0000","last_fullsized":"2024-06-13T11:37:13.714058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:55:00.012631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713171+0000","last_change":"2024-06-13T11:37:07.806718+0000","last_active":"2024-06-13T11:37:13.713171+0000","last_peered":"2024-06-13T11:37:13.713171+0000","last_clean":"2024-06-13T11:37:13.713171+0000","last_became_active":"2024-06-13T11:37:07.806243+0000","last_became_peered":"2024-06-13T11:37:07.806243+0000","last_unstale":"2024-06-13T11:37:13.713171+0000","last_undegraded":"2024-06-13T11:37:13.713171+0000","last_fullsized":"2024-06-13T11:37:13.713171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:44:45.438582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713668+0000","last_change":"2024-06-13T11:37:06.798091+0000","last_active":"2024-06-13T11:37:13.713668+0000","last_peered":"2024-06-13T11:37:13.713668+0000","last_clean":"2024-06-13T11:37:13.713668+0000","last_became_active":"2024-06-13T11:37:06.797712+0000","last_became_peered":"2024-06-13T11:37:06.797712+0000","last_unstale":"2024-06-13T11:37:13.713668+0000","last_undegraded":"2024-06-13T11:37:13.713668+0000","last_fullsized":"2024-06-13T11:37:13.713668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168678+0000","last_change":"2024-06-13T11:37:12.056862+0000","last_active":"2024-06-13T11:37:13.168678+0000","last_peered":"2024-06-13T11:37:13.168678+0000","last_clean":"2024-06-13T11:37:13.168678+0000","last_became_active":"2024-06-13T11:37:12.056394+0000","last_became_peered":"2024-06-13T11:37:12.056394+0000","last_unstale":"2024-06-13T11:37:13.168678+0000","last_undegraded":"2024-06-13T11:37:13.168678+0000","last_fullsized":"2024-06-13T11:37:13.168678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:30:32.045207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152808+0000","last_change":"2024-06-13T11:37:07.816795+0000","last_active":"2024-06-13T11:37:13.152808+0000","last_peered":"2024-06-13T11:37:13.152808+0000","last_clean":"2024-06-13T11:37:13.152808+0000","last_became_active":"2024-06-13T11:37:07.816480+0000","last_became_peered":"2024-06-13T11:37:07.816480+0000","last_unstale":"2024-06-13T11:37:13.152808+0000","last_undegraded":"2024-06-13T11:37:13.152808+0000","last_fullsized":"2024-06-13T11:37:13.152808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:17.399783+0000","last_change":"2024-06-13T11:37:06.793664+0000","last_active":"2024-06-13T11:37:17.399783+0000","last_peered":"2024-06-13T11:37:17.399783+0000","last_clean":"2024-06-13T11:37:17.399783+0000","last_became_active":"2024-06-13T11:37:06.793399+0000","last_became_peered":"2024-06-13T11:37:06.793399+0000","last_unstale":"2024-06-13T11:37:17.399783+0000","last_undegraded":"2024-06-13T11:37:17.399783+0000","last_fullsized":"2024-06-13T11:37:17.399783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:36:10.584343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819864+0000","last_change":"2024-06-13T11:37:11.840940+0000","last_active":"2024-06-13T11:37:12.819864+0000","last_peered":"2024-06-13T11:37:12.819864+0000","last_clean":"2024-06-13T11:37:12.819864+0000","last_became_active":"2024-06-13T11:37:11.840527+0000","last_became_peered":"2024-06-13T11:37:11.840527+0000","last_unstale":"2024-06-13T11:37:12.819864+0000","last_undegraded":"2024-06-13T11:37:12.819864+0000","last_fullsized":"2024-06-13T11:37:12.819864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821244+0000","last_change":"2024-06-13T11:37:07.810016+0000","last_active":"2024-06-13T11:37:12.821244+0000","last_peered":"2024-06-13T11:37:12.821244+0000","last_clean":"2024-06-13T11:37:12.821244+0000","last_became_active":"2024-06-13T11:37:07.809754+0000","last_became_peered":"2024-06-13T11:37:07.809754+0000","last_unstale":"2024-06-13T11:37:12.821244+0000","last_undegraded":"2024-06-13T11:37:12.821244+0000","last_fullsized":"2024-06-13T11:37:12.821244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:11:13.295294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820199+0000","last_change":"2024-06-13T11:37:06.802832+0000","last_active":"2024-06-13T11:37:12.820199+0000","last_peered":"2024-06-13T11:37:12.820199+0000","last_clean":"2024-06-13T11:37:12.820199+0000","last_became_active":"2024-06-13T11:37:06.802502+0000","last_became_peered":"2024-06-13T11:37:06.802502+0000","last_unstale":"2024-06-13T11:37:12.820199+0000","last_undegraded":"2024-06-13T11:37:12.820199+0000","last_fullsized":"2024-06-13T11:37:12.820199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:07.962816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819861+0000","last_change":"2024-06-13T11:37:11.842063+0000","last_active":"2024-06-13T11:37:12.819861+0000","last_peered":"2024-06-13T11:37:12.819861+0000","last_clean":"2024-06-13T11:37:12.819861+0000","last_became_active":"2024-06-13T11:37:11.841560+0000","last_became_peered":"2024-06-13T11:37:11.841560+0000","last_unstale":"2024-06-13T11:37:12.819861+0000","last_undegraded":"2024-06-13T11:37:12.819861+0000","last_fullsized":"2024-06-13T11:37:12.819861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:51.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713089+0000","last_change":"2024-06-13T11:37:07.816725+0000","last_active":"2024-06-13T11:37:13.713089+0000","last_peered":"2024-06-13T11:37:13.713089+0000","last_clean":"2024-06-13T11:37:13.713089+0000","last_became_active":"2024-06-13T11:37:07.816381+0000","last_became_peered":"2024-06-13T11:37:07.816381+0000","last_unstale":"2024-06-13T11:37:13.713089+0000","last_undegraded":"2024-06-13T11:37:13.713089+0000","last_fullsized":"2024-06-13T11:37:13.713089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168737+0000","last_change":"2024-06-13T11:37:06.804917+0000","last_active":"2024-06-13T11:37:13.168737+0000","last_peered":"2024-06-13T11:37:13.168737+0000","last_clean":"2024-06-13T11:37:13.168737+0000","last_became_active":"2024-06-13T11:37:06.804193+0000","last_became_peered":"2024-06-13T11:37:06.804193+0000","last_unstale":"2024-06-13T11:37:13.168737+0000","last_undegraded":"2024-06-13T11:37:13.168737+0000","last_fullsized":"2024-06-13T11:37:13.168737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:16:28.538858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712516+0000","last_change":"2024-06-13T11:37:11.842840+0000","last_active":"2024-06-13T11:37:13.712516+0000","last_peered":"2024-06-13T11:37:13.712516+0000","last_clean":"2024-06-13T11:37:13.712516+0000","last_became_active":"2024-06-13T11:37:11.842012+0000","last_became_peered":"2024-06-13T11:37:11.842012+0000","last_unstale":"2024-06-13T11:37:13.712516+0000","last_undegraded":"2024-06-13T11:37:13.712516+0000","last_fullsized":"2024-06-13T11:37:13.712516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:55.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168668+0000","last_change":"2024-06-13T11:37:07.814121+0000","last_active":"2024-06-13T11:37:13.168668+0000","last_peered":"2024-06-13T11:37:13.168668+0000","last_clean":"2024-06-13T11:37:13.168668+0000","last_became_active":"2024-06-13T11:37:07.813843+0000","last_became_peered":"2024-06-13T11:37:07.813843+0000","last_unstale":"2024-06-13T11:37:13.168668+0000","last_undegraded":"2024-06-13T11:37:13.168668+0000","last_fullsized":"2024-06-13T11:37:13.168668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:44.974316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821122+0000","last_change":"2024-06-13T11:37:06.803877+0000","last_active":"2024-06-13T11:37:12.821122+0000","last_peered":"2024-06-13T11:37:12.821122+0000","last_clean":"2024-06-13T11:37:12.821122+0000","last_became_active":"2024-06-13T11:37:06.803562+0000","last_became_peered":"2024-06-13T11:37:06.803562+0000","last_unstale":"2024-06-13T11:37:12.821122+0000","last_undegraded":"2024-06-13T11:37:12.821122+0000","last_fullsized":"2024-06-13T11:37:12.821122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:57:30.135234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713551+0000","last_change":"2024-06-13T11:37:12.055863+0000","last_active":"2024-06-13T11:37:13.713551+0000","last_peered":"2024-06-13T11:37:13.713551+0000","last_clean":"2024-06-13T11:37:13.713551+0000","last_became_active":"2024-06-13T11:37:12.055240+0000","last_became_peered":"2024-06-13T11:37:12.055240+0000","last_unstale":"2024-06-13T11:37:13.713551+0000","last_undegraded":"2024-06-13T11:37:13.713551+0000","last_fullsized":"2024-06-13T11:37:13.713551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:00.185318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712723+0000","last_change":"2024-06-13T11:37:12.059446+0000","last_active":"2024-06-13T11:37:13.712723+0000","last_peered":"2024-06-13T11:37:13.712723+0000","last_clean":"2024-06-13T11:37:13.712723+0000","last_became_active":"2024-06-13T11:37:12.057697+0000","last_became_peered":"2024-06-13T11:37:12.057697+0000","last_unstale":"2024-06-13T11:37:13.712723+0000","last_undegraded":"2024-06-13T11:37:13.712723+0000","last_fullsized":"2024-06-13T11:37:13.712723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:53:45.610032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819164+0000","last_change":"2024-06-13T11:37:07.814989+0000","last_active":"2024-06-13T11:37:12.819164+0000","last_peered":"2024-06-13T11:37:12.819164+0000","last_clean":"2024-06-13T11:37:12.819164+0000","last_became_active":"2024-06-13T11:37:07.814564+0000","last_became_peered":"2024-06-13T11:37:07.814564+0000","last_unstale":"2024-06-13T11:37:12.819164+0000","last_undegraded":"2024-06-13T11:37:12.819164+0000","last_fullsized":"2024-06-13T11:37:12.819164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168310+0000","last_change":"2024-06-13T11:37:06.802741+0000","last_active":"2024-06-13T11:37:13.168310+0000","last_peered":"2024-06-13T11:37:13.168310+0000","last_clean":"2024-06-13T11:37:13.168310+0000","last_became_active":"2024-06-13T11:37:06.802409+0000","last_became_peered":"2024-06-13T11:37:06.802409+0000","last_unstale":"2024-06-13T11:37:13.168310+0000","last_undegraded":"2024-06-13T11:37:13.168310+0000","last_fullsized":"2024-06-13T11:37:13.168310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:05:54.761290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819943+0000","last_change":"2024-06-13T11:37:11.841003+0000","last_active":"2024-06-13T11:37:12.819943+0000","last_peered":"2024-06-13T11:37:12.819943+0000","last_clean":"2024-06-13T11:37:12.819943+0000","last_became_active":"2024-06-13T11:37:11.840537+0000","last_became_peered":"2024-06-13T11:37:11.840537+0000","last_unstale":"2024-06-13T11:37:12.819943+0000","last_undegraded":"2024-06-13T11:37:12.819943+0000","last_fullsized":"2024-06-13T11:37:12.819943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:16:14.249413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712613+0000","last_change":"2024-06-13T11:37:07.814236+0000","last_active":"2024-06-13T11:37:13.712613+0000","last_peered":"2024-06-13T11:37:13.712613+0000","last_clean":"2024-06-13T11:37:13.712613+0000","last_became_active":"2024-06-13T11:37:07.813951+0000","last_became_peered":"2024-06-13T11:37:07.813951+0000","last_unstale":"2024-06-13T11:37:13.712613+0000","last_undegraded":"2024-06-13T11:37:13.712613+0000","last_fullsized":"2024-06-13T11:37:13.712613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713871+0000","last_change":"2024-06-13T11:37:06.793599+0000","last_active":"2024-06-13T11:37:13.713871+0000","last_peered":"2024-06-13T11:37:13.713871+0000","last_clean":"2024-06-13T11:37:13.713871+0000","last_became_active":"2024-06-13T11:37:06.793280+0000","last_became_peered":"2024-06-13T11:37:06.793280+0000","last_unstale":"2024-06-13T11:37:13.713871+0000","last_undegraded":"2024-06-13T11:37:13.713871+0000","last_fullsized":"2024-06-13T11:37:13.713871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:21:50.012238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821282+0000","last_change":"2024-06-13T11:37:06.794432+0000","last_active":"2024-06-13T11:37:12.821282+0000","last_peered":"2024-06-13T11:37:12.821282+0000","last_clean":"2024-06-13T11:37:12.821282+0000","last_became_active":"2024-06-13T11:37:06.794119+0000","last_became_peered":"2024-06-13T11:37:06.794119+0000","last_unstale":"2024-06-13T11:37:12.821282+0000","last_undegraded":"2024-06-13T11:37:12.821282+0000","last_fullsized":"2024-06-13T11:37:12.821282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:27:43.201581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713576+0000","last_change":"2024-06-13T11:37:07.809910+0000","last_active":"2024-06-13T11:37:13.713576+0000","last_peered":"2024-06-13T11:37:13.713576+0000","last_clean":"2024-06-13T11:37:13.713576+0000","last_became_active":"2024-06-13T11:37:07.809587+0000","last_became_peered":"2024-06-13T11:37:07.809587+0000","last_unstale":"2024-06-13T11:37:13.713576+0000","last_undegraded":"2024-06-13T11:37:13.713576+0000","last_fullsized":"2024-06-13T11:37:13.713576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712785+0000","last_change":"2024-06-13T11:37:11.832051+0000","last_active":"2024-06-13T11:37:13.712785+0000","last_peered":"2024-06-13T11:37:13.712785+0000","last_clean":"2024-06-13T11:37:13.712785+0000","last_became_active":"2024-06-13T11:37:11.831633+0000","last_became_peered":"2024-06-13T11:37:11.831633+0000","last_unstale":"2024-06-13T11:37:13.712785+0000","last_undegraded":"2024-06-13T11:37:13.712785+0000","last_fullsized":"2024-06-13T11:37:13.712785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:03:22.884367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713873+0000","last_change":"2024-06-13T11:37:06.797052+0000","last_active":"2024-06-13T11:37:13.713873+0000","last_peered":"2024-06-13T11:37:13.713873+0000","last_clean":"2024-06-13T11:37:13.713873+0000","last_became_active":"2024-06-13T11:37:06.796723+0000","last_became_peered":"2024-06-13T11:37:06.796723+0000","last_unstale":"2024-06-13T11:37:13.713873+0000","last_undegraded":"2024-06-13T11:37:13.713873+0000","last_fullsized":"2024-06-13T11:37:13.713873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:05.771166+0000","last_clean_scrub_stamp":"2024-06-13T11:37:05.771166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:33:47.050762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819596+0000","last_change":"2024-06-13T11:37:07.805771+0000","last_active":"2024-06-13T11:37:12.819596+0000","last_peered":"2024-06-13T11:37:12.819596+0000","last_clean":"2024-06-13T11:37:12.819596+0000","last_became_active":"2024-06-13T11:37:07.805463+0000","last_became_peered":"2024-06-13T11:37:07.805463+0000","last_unstale":"2024-06-13T11:37:12.819596+0000","last_undegraded":"2024-06-13T11:37:12.819596+0000","last_fullsized":"2024-06-13T11:37:12.819596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:33:44.456986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713722+0000","last_change":"2024-06-13T11:37:11.841035+0000","last_active":"2024-06-13T11:37:13.713722+0000","last_peered":"2024-06-13T11:37:13.713722+0000","last_clean":"2024-06-13T11:37:13.713722+0000","last_became_active":"2024-06-13T11:37:11.840626+0000","last_became_peered":"2024-06-13T11:37:11.840626+0000","last_unstale":"2024-06-13T11:37:13.713722+0000","last_undegraded":"2024-06-13T11:37:13.713722+0000","last_fullsized":"2024-06-13T11:37:13.713722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:10.808819+0000","last_clean_scrub_stamp":"2024-06-13T11:37:10.808819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:32:57.521991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820017+0000","last_change":"2024-06-13T11:37:07.816052+0000","last_active":"2024-06-13T11:37:12.820017+0000","last_peered":"2024-06-13T11:37:12.820017+0000","last_clean":"2024-06-13T11:37:12.820017+0000","last_became_active":"2024-06-13T11:37:07.815407+0000","last_became_peered":"2024-06-13T11:37:07.815407+0000","last_unstale":"2024-06-13T11:37:12.820017+0000","last_undegraded":"2024-06-13T11:37:12.820017+0000","last_fullsized":"2024-06-13T11:37:12.820017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:22:45.326163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712280+0000","last_change":"2024-06-13T11:37:07.813338+0000","last_active":"2024-06-13T11:37:13.712280+0000","last_peered":"2024-06-13T11:37:13.712280+0000","last_clean":"2024-06-13T11:37:13.712280+0000","last_became_active":"2024-06-13T11:37:07.813058+0000","last_became_peered":"2024-06-13T11:37:07.813058+0000","last_unstale":"2024-06-13T11:37:13.712280+0000","last_undegraded":"2024-06-13T11:37:13.712280+0000","last_fullsized":"2024-06-13T11:37:13.712280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:52:04.020273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168311+0000","last_change":"2024-06-13T11:37:07.814579+0000","last_active":"2024-06-13T11:37:13.168311+0000","last_peered":"2024-06-13T11:37:13.168311+0000","last_clean":"2024-06-13T11:37:13.168311+0000","last_became_active":"2024-06-13T11:37:07.814287+0000","last_became_peered":"2024-06-13T11:37:07.814287+0000","last_unstale":"2024-06-13T11:37:13.168311+0000","last_undegraded":"2024-06-13T11:37:13.168311+0000","last_fullsized":"2024-06-13T11:37:13.168311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:35.392213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713460+0000","last_change":"2024-06-13T11:37:07.812453+0000","last_active":"2024-06-13T11:37:13.713460+0000","last_peered":"2024-06-13T11:37:13.713460+0000","last_clean":"2024-06-13T11:37:13.713460+0000","last_became_active":"2024-06-13T11:37:07.812179+0000","last_became_peered":"2024-06-13T11:37:07.812179+0000","last_unstale":"2024-06-13T11:37:13.713460+0000","last_undegraded":"2024-06-13T11:37:13.713460+0000","last_fullsized":"2024-06-13T11:37:13.713460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714168+0000","last_change":"2024-06-13T11:37:07.809534+0000","last_active":"2024-06-13T11:37:13.714168+0000","last_peered":"2024-06-13T11:37:13.714168+0000","last_clean":"2024-06-13T11:37:13.714168+0000","last_became_active":"2024-06-13T11:37:07.809238+0000","last_became_peered":"2024-06-13T11:37:07.809238+0000","last_unstale":"2024-06-13T11:37:13.714168+0000","last_undegraded":"2024-06-13T11:37:13.714168+0000","last_fullsized":"2024-06-13T11:37:13.714168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:16:41.866755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819893+0000","last_change":"2024-06-13T11:37:07.818257+0000","last_active":"2024-06-13T11:37:12.819893+0000","last_peered":"2024-06-13T11:37:12.819893+0000","last_clean":"2024-06-13T11:37:12.819893+0000","last_became_active":"2024-06-13T11:37:07.817910+0000","last_became_peered":"2024-06-13T11:37:07.817910+0000","last_unstale":"2024-06-13T11:37:12.819893+0000","last_undegraded":"2024-06-13T11:37:12.819893+0000","last_fullsized":"2024-06-13T11:37:12.819893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821518+0000","last_change":"2024-06-13T11:37:07.810465+0000","last_active":"2024-06-13T11:37:12.821518+0000","last_peered":"2024-06-13T11:37:12.821518+0000","last_clean":"2024-06-13T11:37:12.821518+0000","last_became_active":"2024-06-13T11:37:07.810018+0000","last_became_peered":"2024-06-13T11:37:07.810018+0000","last_unstale":"2024-06-13T11:37:12.821518+0000","last_undegraded":"2024-06-13T11:37:12.821518+0000","last_fullsized":"2024-06-13T11:37:12.821518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.714221+0000","last_change":"2024-06-13T11:37:07.807899+0000","last_active":"2024-06-13T11:37:13.714221+0000","last_peered":"2024-06-13T11:37:13.714221+0000","last_clean":"2024-06-13T11:37:13.714221+0000","last_became_active":"2024-06-13T11:37:07.807583+0000","last_became_peered":"2024-06-13T11:37:07.807583+0000","last_unstale":"2024-06-13T11:37:13.714221+0000","last_undegraded":"2024-06-13T11:37:13.714221+0000","last_fullsized":"2024-06-13T11:37:13.714221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:11.241283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168187+0000","last_change":"2024-06-13T11:37:07.803581+0000","last_active":"2024-06-13T11:37:13.168187+0000","last_peered":"2024-06-13T11:37:13.168187+0000","last_clean":"2024-06-13T11:37:13.168187+0000","last_became_active":"2024-06-13T11:37:07.803152+0000","last_became_peered":"2024-06-13T11:37:07.803152+0000","last_unstale":"2024-06-13T11:37:13.168187+0000","last_undegraded":"2024-06-13T11:37:13.168187+0000","last_fullsized":"2024-06-13T11:37:13.168187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713706+0000","last_change":"2024-06-13T11:37:07.805036+0000","last_active":"2024-06-13T11:37:13.713706+0000","last_peered":"2024-06-13T11:37:13.713706+0000","last_clean":"2024-06-13T11:37:13.713706+0000","last_became_active":"2024-06-13T11:37:07.804074+0000","last_became_peered":"2024-06-13T11:37:07.804074+0000","last_unstale":"2024-06-13T11:37:13.713706+0000","last_undegraded":"2024-06-13T11:37:13.713706+0000","last_fullsized":"2024-06-13T11:37:13.713706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:32:19.911394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168271+0000","last_change":"2024-06-13T11:37:07.822794+0000","last_active":"2024-06-13T11:37:13.168271+0000","last_peered":"2024-06-13T11:37:13.168271+0000","last_clean":"2024-06-13T11:37:13.168271+0000","last_became_active":"2024-06-13T11:37:07.822476+0000","last_became_peered":"2024-06-13T11:37:07.822476+0000","last_unstale":"2024-06-13T11:37:13.168271+0000","last_undegraded":"2024-06-13T11:37:13.168271+0000","last_fullsized":"2024-06-13T11:37:13.168271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713222+0000","last_change":"2024-06-13T11:37:07.810639+0000","last_active":"2024-06-13T11:37:13.713222+0000","last_peered":"2024-06-13T11:37:13.713222+0000","last_clean":"2024-06-13T11:37:13.713222+0000","last_became_active":"2024-06-13T11:37:07.810285+0000","last_became_peered":"2024-06-13T11:37:07.810285+0000","last_unstale":"2024-06-13T11:37:13.713222+0000","last_undegraded":"2024-06-13T11:37:13.713222+0000","last_fullsized":"2024-06-13T11:37:13.713222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:24:37.698879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821000+0000","last_change":"2024-06-13T11:37:07.804880+0000","last_active":"2024-06-13T11:37:12.821000+0000","last_peered":"2024-06-13T11:37:12.821000+0000","last_clean":"2024-06-13T11:37:12.821000+0000","last_became_active":"2024-06-13T11:37:07.803451+0000","last_became_peered":"2024-06-13T11:37:07.803451+0000","last_unstale":"2024-06-13T11:37:12.821000+0000","last_undegraded":"2024-06-13T11:37:12.821000+0000","last_fullsized":"2024-06-13T11:37:12.821000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:10:59.938653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153125+0000","last_change":"2024-06-13T11:37:07.808713+0000","last_active":"2024-06-13T11:37:13.153125+0000","last_peered":"2024-06-13T11:37:13.153125+0000","last_clean":"2024-06-13T11:37:13.153125+0000","last_became_active":"2024-06-13T11:37:07.808422+0000","last_became_peered":"2024-06-13T11:37:07.808422+0000","last_unstale":"2024-06-13T11:37:13.153125+0000","last_undegraded":"2024-06-13T11:37:13.153125+0000","last_fullsized":"2024-06-13T11:37:13.153125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:47.602345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712358+0000","last_change":"2024-06-13T11:37:07.808193+0000","last_active":"2024-06-13T11:37:13.712358+0000","last_peered":"2024-06-13T11:37:13.712358+0000","last_clean":"2024-06-13T11:37:13.712358+0000","last_became_active":"2024-06-13T11:37:07.807809+0000","last_became_peered":"2024-06-13T11:37:07.807809+0000","last_unstale":"2024-06-13T11:37:13.712358+0000","last_undegraded":"2024-06-13T11:37:13.712358+0000","last_fullsized":"2024-06-13T11:37:13.712358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:08.966864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168884+0000","last_change":"2024-06-13T11:37:07.826457+0000","last_active":"2024-06-13T11:37:13.168884+0000","last_peered":"2024-06-13T11:37:13.168884+0000","last_clean":"2024-06-13T11:37:13.168884+0000","last_became_active":"2024-06-13T11:37:07.826150+0000","last_became_peered":"2024-06-13T11:37:07.826150+0000","last_unstale":"2024-06-13T11:37:13.168884+0000","last_undegraded":"2024-06-13T11:37:13.168884+0000","last_fullsized":"2024-06-13T11:37:13.168884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:02:14.319466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168030+0000","last_change":"2024-06-13T11:37:07.817291+0000","last_active":"2024-06-13T11:37:13.168030+0000","last_peered":"2024-06-13T11:37:13.168030+0000","last_clean":"2024-06-13T11:37:13.168030+0000","last_became_active":"2024-06-13T11:37:07.817016+0000","last_became_peered":"2024-06-13T11:37:07.817016+0000","last_unstale":"2024-06-13T11:37:13.168030+0000","last_undegraded":"2024-06-13T11:37:13.168030+0000","last_fullsized":"2024-06-13T11:37:13.168030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:10.222966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.819296+0000","last_change":"2024-06-13T11:37:07.807833+0000","last_active":"2024-06-13T11:37:12.819296+0000","last_peered":"2024-06-13T11:37:12.819296+0000","last_clean":"2024-06-13T11:37:12.819296+0000","last_became_active":"2024-06-13T11:37:07.807536+0000","last_became_peered":"2024-06-13T11:37:07.807536+0000","last_unstale":"2024-06-13T11:37:12.819296+0000","last_undegraded":"2024-06-13T11:37:12.819296+0000","last_fullsized":"2024-06-13T11:37:12.819296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713077+0000","last_change":"2024-06-13T11:37:07.809789+0000","last_active":"2024-06-13T11:37:13.713077+0000","last_peered":"2024-06-13T11:37:13.713077+0000","last_clean":"2024-06-13T11:37:13.713077+0000","last_became_active":"2024-06-13T11:37:07.809493+0000","last_became_peered":"2024-06-13T11:37:07.809493+0000","last_unstale":"2024-06-13T11:37:13.713077+0000","last_undegraded":"2024-06-13T11:37:13.713077+0000","last_fullsized":"2024-06-13T11:37:13.713077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:13:00.616643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.713659+0000","last_change":"2024-06-13T11:37:07.808038+0000","last_active":"2024-06-13T11:37:13.713659+0000","last_peered":"2024-06-13T11:37:13.713659+0000","last_clean":"2024-06-13T11:37:13.713659+0000","last_became_active":"2024-06-13T11:37:07.807727+0000","last_became_peered":"2024-06-13T11:37:07.807727+0000","last_unstale":"2024-06-13T11:37:13.713659+0000","last_undegraded":"2024-06-13T11:37:13.713659+0000","last_fullsized":"2024-06-13T11:37:13.713659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821132+0000","last_change":"2024-06-13T11:37:07.807879+0000","last_active":"2024-06-13T11:37:12.821132+0000","last_peered":"2024-06-13T11:37:12.821132+0000","last_clean":"2024-06-13T11:37:12.821132+0000","last_became_active":"2024-06-13T11:37:07.807538+0000","last_became_peered":"2024-06-13T11:37:07.807538+0000","last_unstale":"2024-06-13T11:37:12.821132+0000","last_undegraded":"2024-06-13T11:37:12.821132+0000","last_fullsized":"2024-06-13T11:37:12.821132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:37:33.935198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821182+0000","last_change":"2024-06-13T11:37:07.809717+0000","last_active":"2024-06-13T11:37:12.821182+0000","last_peered":"2024-06-13T11:37:12.821182+0000","last_clean":"2024-06-13T11:37:12.821182+0000","last_became_active":"2024-06-13T11:37:07.809444+0000","last_became_peered":"2024-06-13T11:37:07.809444+0000","last_unstale":"2024-06-13T11:37:12.821182+0000","last_undegraded":"2024-06-13T11:37:12.821182+0000","last_fullsized":"2024-06-13T11:37:12.821182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:42:55.177684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.821499+0000","last_change":"2024-06-13T11:37:07.810594+0000","last_active":"2024-06-13T11:37:12.821499+0000","last_peered":"2024-06-13T11:37:12.821499+0000","last_clean":"2024-06-13T11:37:12.821499+0000","last_became_active":"2024-06-13T11:37:07.810177+0000","last_became_peered":"2024-06-13T11:37:07.810177+0000","last_unstale":"2024-06-13T11:37:12.821499+0000","last_undegraded":"2024-06-13T11:37:12.821499+0000","last_fullsized":"2024-06-13T11:37:12.821499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:32.943198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153218+0000","last_change":"2024-06-13T11:37:07.824727+0000","last_active":"2024-06-13T11:37:13.153218+0000","last_peered":"2024-06-13T11:37:13.153218+0000","last_clean":"2024-06-13T11:37:13.153218+0000","last_became_active":"2024-06-13T11:37:07.824440+0000","last_became_peered":"2024-06-13T11:37:07.824440+0000","last_unstale":"2024-06-13T11:37:13.153218+0000","last_undegraded":"2024-06-13T11:37:13.153218+0000","last_fullsized":"2024-06-13T11:37:13.153218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:39:04.148148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712370+0000","last_change":"2024-06-13T11:37:07.811181+0000","last_active":"2024-06-13T11:37:13.712370+0000","last_peered":"2024-06-13T11:37:13.712370+0000","last_clean":"2024-06-13T11:37:13.712370+0000","last_became_active":"2024-06-13T11:37:07.810827+0000","last_became_peered":"2024-06-13T11:37:07.810827+0000","last_unstale":"2024-06-13T11:37:13.712370+0000","last_undegraded":"2024-06-13T11:37:13.712370+0000","last_fullsized":"2024-06-13T11:37:13.712370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:10.592664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152419+0000","last_change":"2024-06-13T11:37:07.817006+0000","last_active":"2024-06-13T11:37:13.152419+0000","last_peered":"2024-06-13T11:37:13.152419+0000","last_clean":"2024-06-13T11:37:13.152419+0000","last_became_active":"2024-06-13T11:37:07.816608+0000","last_became_peered":"2024-06-13T11:37:07.816608+0000","last_unstale":"2024-06-13T11:37:13.152419+0000","last_undegraded":"2024-06-13T11:37:13.152419+0000","last_fullsized":"2024-06-13T11:37:13.152419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:58:12.804878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168151+0000","last_change":"2024-06-13T11:37:07.816639+0000","last_active":"2024-06-13T11:37:13.168151+0000","last_peered":"2024-06-13T11:37:13.168151+0000","last_clean":"2024-06-13T11:37:13.168151+0000","last_became_active":"2024-06-13T11:37:07.816347+0000","last_became_peered":"2024-06-13T11:37:07.816347+0000","last_unstale":"2024-06-13T11:37:13.168151+0000","last_undegraded":"2024-06-13T11:37:13.168151+0000","last_fullsized":"2024-06-13T11:37:13.168151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:28:30.350625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.152445+0000","last_change":"2024-06-13T11:37:07.818920+0000","last_active":"2024-06-13T11:37:13.152445+0000","last_peered":"2024-06-13T11:37:13.152445+0000","last_clean":"2024-06-13T11:37:13.152445+0000","last_became_active":"2024-06-13T11:37:07.818628+0000","last_became_peered":"2024-06-13T11:37:07.818628+0000","last_unstale":"2024-06-13T11:37:13.152445+0000","last_undegraded":"2024-06-13T11:37:13.152445+0000","last_fullsized":"2024-06-13T11:37:13.152445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:16:47.477400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.168341+0000","last_change":"2024-06-13T11:37:07.812235+0000","last_active":"2024-06-13T11:37:13.168341+0000","last_peered":"2024-06-13T11:37:13.168341+0000","last_clean":"2024-06-13T11:37:13.168341+0000","last_became_active":"2024-06-13T11:37:07.811740+0000","last_became_peered":"2024-06-13T11:37:07.811740+0000","last_unstale":"2024-06-13T11:37:13.168341+0000","last_undegraded":"2024-06-13T11:37:13.168341+0000","last_fullsized":"2024-06-13T11:37:13.168341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:24:14.572925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.712830+0000","last_change":"2024-06-13T11:37:07.810203+0000","last_active":"2024-06-13T11:37:13.712830+0000","last_peered":"2024-06-13T11:37:13.712830+0000","last_clean":"2024-06-13T11:37:13.712830+0000","last_became_active":"2024-06-13T11:37:07.809607+0000","last_became_peered":"2024-06-13T11:37:07.809607+0000","last_unstale":"2024-06-13T11:37:13.712830+0000","last_undegraded":"2024-06-13T11:37:13.712830+0000","last_fullsized":"2024-06-13T11:37:13.712830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:12.820323+0000","last_change":"2024-06-13T11:37:07.815528+0000","last_active":"2024-06-13T11:37:12.820323+0000","last_peered":"2024-06-13T11:37:12.820323+0000","last_clean":"2024-06-13T11:37:12.820323+0000","last_became_active":"2024-06-13T11:37:07.815240+0000","last_became_peered":"2024-06-13T11:37:07.815240+0000","last_unstale":"2024-06-13T11:37:12.820323+0000","last_undegraded":"2024-06-13T11:37:12.820323+0000","last_fullsized":"2024-06-13T11:37:12.820323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:10:14.068165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-06-13T11:37:13.153117+0000","last_change":"2024-06-13T11:37:07.822539+0000","last_active":"2024-06-13T11:37:13.153117+0000","last_peered":"2024-06-13T11:37:13.153117+0000","last_clean":"2024-06-13T11:37:13.153117+0000","last_became_active":"2024-06-13T11:37:07.820878+0000","last_became_peered":"2024-06-13T11:37:07.820878+0000","last_unstale":"2024-06-13T11:37:13.153117+0000","last_undegraded":"2024-06-13T11:37:13.153117+0000","last_fullsized":"2024-06-13T11:37:13.153117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:06.775213+0000","last_clean_scrub_stamp":"2024-06-13T11:37:06.775213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:51.638079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":694641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":103781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":103817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":103691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":103851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":694697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":107532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:37:26.721 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-13T11:37:26.721 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-13T11:37:26.721 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-13T11:37:26.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-13T11:37:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.860+0000 7efc3cc26640 1 Processor -- start 2024-06-13T11:37:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.860+0000 7efc3cc26640 1 -- start start 2024-06-13T11:37:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3cc26640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc38144d40 0x7efc380718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3cc26640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc38071ea0 con 0x7efc38072f40 2024-06-13T11:37:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3cc26640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc38072180 con 0x7efc380d0dd0 2024-06-13T11:37:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3cc26640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efc38072460 con 0x7efc38144d40 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc2dd9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7efc38072f40 0x7efc380d0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53042/0 (socket says 172.21.15.43:53042) 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc2dd9b640 1 -- 172.21.15.43:0/3989286068 learned_addr learned my addr 172.21.15.43:0/3989286068 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3659c640 1 --2- 172.21.15.43:0/3989286068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc38144d40 0x7efc380718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220425730 0 0) 0x7efc38071ea0 con 0x7efc38072f40 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc24003520 con 0x7efc38072f40 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861432631 0 0) 0x7efc38072180 con 0x7efc380d0dd0 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc38071ea0 con 0x7efc380d0dd0 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3659c640 1 -- 172.21.15.43:0/3989286068 >> v1:172.21.15.53:6789/0 conn(0x7efc380d0dd0 legacy=0x7efc38145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3659c640 1 -- 172.21.15.43:0/3989286068 >> v1:172.21.15.43:6789/0 conn(0x7efc38072f40 legacy=0x7efc380d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.861+0000 7efc3659c640 1 -- 172.21.15.43:0/3989286068 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc38072740 con 0x7efc38144d40 2024-06-13T11:37:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.862+0000 7efc3659c640 1 --2- 172.21.15.43:0/3989286068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc38144d40 0x7efc380718c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efc280097d0 tx=0x7efc2802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c64d20faca3fbf0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.862+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28037070 con 0x7efc38144d40 2024-06-13T11:37:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.862+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28032440 con 0x7efc38144d40 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.862+0000 7efc35d9b640 1 -- 172.21.15.43:0/3989286068 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28032810 con 0x7efc38144d40 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 -- 172.21.15.43:0/3989286068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc38144d40 msgr2=0x7efc380718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 --2- 172.21.15.43:0/3989286068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc38144d40 0x7efc380718c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efc280097d0 tx=0x7efc2802a210 comp rx=0 tx=0).stop 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 -- 172.21.15.43:0/3989286068 shutdown_connections 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 --2- 172.21.15.43:0/3989286068 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc38144d40 0x7efc380718c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 -- 172.21.15.43:0/3989286068 >> 172.21.15.43:0/3989286068 conn(0x7efc38070810 msgr2=0x7efc38070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 -- 172.21.15.43:0/3989286068 shutdown_connections 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.863+0000 7efc3cc26640 1 -- 172.21.15.43:0/3989286068 wait complete. 2024-06-13T11:37:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.864+0000 7efc3cc26640 1 Processor -- start 2024-06-13T11:37:26.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.864+0000 7efc3cc26640 1 -- start start 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3cc26640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 0x7efc38155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3cc26640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc380d0dd0 0x7efc3815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3cc26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc38144d40 0x7efc381f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3cc26640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc38145120 con 0x7efc38072f40 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3cc26640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc380733a0 con 0x7efc38144d40 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3cc26640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efc381f68a0 con 0x7efc380d0dd0 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 0x7efc38155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 0x7efc38155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47786/0 (socket says 172.21.15.43:47786) 2024-06-13T11:37:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc3659c640 1 -- 172.21.15.43:0/1014645793 learned_addr learned my addr 172.21.15.43:0/1014645793 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc2dd9b640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc380d0dd0 0x7efc3815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.865+0000 7efc36d9d640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc38144d40 0x7efc381f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.866+0000 7efc3659c640 1 -- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc380d0dd0 msgr2=0x7efc3815ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.866+0000 7efc3659c640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc380d0dd0 0x7efc3815ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.866+0000 7efc3659c640 1 -- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc38144d40 msgr2=0x7efc381f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.866+0000 7efc3659c640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc38144d40 0x7efc381f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.866+0000 7efc3659c640 1 -- 172.21.15.43:0/1014645793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc38156140 con 0x7efc38072f40 2024-06-13T11:37:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.866+0000 7efc3659c640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 0x7efc38155c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc280097d0 tx=0x7efc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.867+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28041020 con 0x7efc38072f40 2024-06-13T11:37:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.867+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2803d640 con 0x7efc38072f40 2024-06-13T11:37:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.867+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc381f5c90 con 0x7efc38072f40 2024-06-13T11:37:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.867+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28037040 con 0x7efc38072f40 2024-06-13T11:37:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.867+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381f6250 con 0x7efc38072f40 2024-06-13T11:37:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.868+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3804ffb0 con 0x7efc38072f40 2024-06-13T11:37:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.868+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc28044020 con 0x7efc38072f40 2024-06-13T11:37:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.868+0000 7efc2f7fe640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efc1806be30 0x7efc1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.869+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc280ab770 con 0x7efc38072f40 2024-06-13T11:37:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.869+0000 7efc2dd9b640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efc1806be30 0x7efc1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.869+0000 7efc2dd9b640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efc1806be30 0x7efc1806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc38140b80 tx=0x7efc20007d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:26.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:26.873+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc2804b030 con 0x7efc38072f40 2024-06-13T11:37:27.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.098+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efc38071620 con 0x7efc38072f40 2024-06-13T11:37:27.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.098+0000 7efc2f7fe640 1 -- 172.21.15.43:0/1014645793 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7efc280797a0 con 0x7efc38072f40 2024-06-13T11:37:27.097 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:27.098 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-13T11:37:27.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efc1806be30 msgr2=0x7efc1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efc1806be30 0x7efc1806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc38140b80 tx=0x7efc20007d70 comp rx=0 tx=0).stop 2024-06-13T11:37:27.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 msgr2=0x7efc38155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 0x7efc38155c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc280097d0 tx=0x7efc280046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 shutdown_connections 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efc1806be30 0x7efc1806e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc38144d40 0x7efc381f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efc380d0dd0 0x7efc3815ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 --2- 172.21.15.43:0/1014645793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc38072f40 0x7efc38155c00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 >> 172.21.15.43:0/1014645793 conn(0x7efc38070810 msgr2=0x7efc3815e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 shutdown_connections 2024-06-13T11:37:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.100+0000 7efc3cc26640 1 -- 172.21.15.43:0/1014645793 wait complete. 2024-06-13T11:37:27.110 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-13T11:37:27.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.215+0000 7f03aca0e640 1 Processor -- start 2024-06-13T11:37:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.215+0000 7f03aca0e640 1 -- start start 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03aca0e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a81412d0 0x7f03a806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03aca0e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f03a806f090 0x7f03a8161f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03aca0e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a81416b0 con 0x7f03a8162470 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03aca0e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f03a80b1af0 con 0x7f03a806f090 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03aca0e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f03a8162cd0 con 0x7f03a81412d0 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f03a806f090 0x7f03a8161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f03a806f090 0x7f03a8161f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47792/0 (socket says 172.21.15.43:47792) 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 -- 172.21.15.43:0/58243866 learned_addr learned my addr 172.21.15.43:0/58243866 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a659c640 1 --2- 172.21.15.43:0/58243866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a81412d0 0x7f03a806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 -- 172.21.15.43:0/58243866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a81412d0 msgr2=0x7f03a806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 --2- 172.21.15.43:0/58243866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a81412d0 0x7f03a806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 -- 172.21.15.43:0/58243866 >> v1:172.21.15.53:6789/0 conn(0x7f03a8162470 legacy=0x7f03a8070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.216+0000 7f03a5d9b640 1 -- 172.21.15.43:0/58243866 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a815ebe0 con 0x7f03a806f090 2024-06-13T11:37:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.217+0000 7f03a5d9b640 1 --2- 172.21.15.43:0/58243866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a806f090 0x7f03a8161f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0390009870 tx=0x7f039002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d452619d87ebe61 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.217+0000 7f03a559a640 1 -- 172.21.15.43:0/58243866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390037070 con 0x7f03a806f090 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.217+0000 7f03a559a640 1 -- 172.21.15.43:0/58243866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0390032440 con 0x7f03a806f090 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.217+0000 7f03a559a640 1 -- 172.21.15.43:0/58243866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0390032810 con 0x7f03a806f090 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 -- 172.21.15.43:0/58243866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a806f090 msgr2=0x7f03a8161f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 --2- 172.21.15.43:0/58243866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a806f090 0x7f03a8161f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0390009870 tx=0x7f039002a270 comp rx=0 tx=0).stop 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 -- 172.21.15.43:0/58243866 shutdown_connections 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 --2- 172.21.15.43:0/58243866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a806f090 0x7f03a8161f30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 --2- 172.21.15.43:0/58243866 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a81412d0 0x7f03a806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 -- 172.21.15.43:0/58243866 >> 172.21.15.43:0/58243866 conn(0x7f03a806e030 msgr2=0x7f03a806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:27.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 -- 172.21.15.43:0/58243866 shutdown_connections 2024-06-13T11:37:27.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.218+0000 7f03aca0e640 1 -- 172.21.15.43:0/58243866 wait complete. 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.219+0000 7f03aca0e640 1 Processor -- start 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.219+0000 7f03aca0e640 1 -- start start 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03aca0e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a806f090 0x7f03a813ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03aca0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a81412d0 0x7f03a8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03aca0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 0x7f03a81f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03aca0e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03a815e890 con 0x7f03a8162470 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03aca0e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f03a815f1a0 con 0x7f03a81412d0 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03aca0e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f03a815f6c0 con 0x7f03a806f090 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 0x7f03a81f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 0x7f03a81f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47802/0 (socket says 172.21.15.43:47802) 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 -- 172.21.15.43:0/1291029395 learned_addr learned my addr 172.21.15.43:0/1291029395 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:27.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a5d9b640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a81412d0 0x7f03a8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a659c640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a806f090 0x7f03a813ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 -- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a806f090 msgr2=0x7f03a813ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a806f090 0x7f03a813ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 -- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a81412d0 msgr2=0x7f03a8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a81412d0 0x7f03a8156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a6d9d640 1 -- 172.21.15.43:0/1291029395 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a81f52f0 con 0x7f03a8162470 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.220+0000 7f03a5d9b640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a81412d0 0x7f03a8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.221+0000 7f03a6d9d640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 0x7f03a81f4db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0398001eb0 tx=0x7f039800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.221+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398017070 con 0x7f03a8162470 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.221+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03980052d0 con 0x7f03a8162470 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.221+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a8156f10 con 0x7f03a8162470 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.221+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398003810 con 0x7f03a8162470 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.221+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a81574d0 con 0x7f03a8162470 2024-06-13T11:37:27.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.222+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a804ffb0 con 0x7f03a8162470 2024-06-13T11:37:27.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.222+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f039801a070 con 0x7f03a8162470 2024-06-13T11:37:27.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.223+0000 7f039effd640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f038806be30 0x7f038806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.223+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f039808a4d0 con 0x7f03a8162470 2024-06-13T11:37:27.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.223+0000 7f03a659c640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f038806be30 0x7f038806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.223+0000 7f03a659c640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f038806be30 0x7f038806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f03a8155200 tx=0x7f03a00039b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.227+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0398058bd0 con 0x7f03a8162470 2024-06-13T11:37:27.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.453+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03a80d10f0 con 0x7f03a8162470 2024-06-13T11:37:27.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.453+0000 7f039effd640 1 -- 172.21.15.43:0/1291029395 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f03980584d0 con 0x7f03a8162470 2024-06-13T11:37:27.452 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:27.452 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:27.453 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.455+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f038806be30 msgr2=0x7f038806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.455+0000 7f03aca0e640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f038806be30 0x7f038806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f03a8155200 tx=0x7f03a00039b0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.455+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 msgr2=0x7f03a81f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.455+0000 7f03aca0e640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 0x7f03a81f4db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0398001eb0 tx=0x7f039800c890 comp rx=0 tx=0).stop 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.455+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 shutdown_connections 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f038806be30 0x7f038806e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a8162470 0x7f03a81f4db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a81412d0 0x7f03a8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 --2- 172.21.15.43:0/1291029395 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f03a806f090 0x7f03a813ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 >> 172.21.15.43:0/1291029395 conn(0x7f03a806e030 msgr2=0x7f03a80719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:27.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 shutdown_connections 2024-06-13T11:37:27.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.456+0000 7f03aca0e640 1 -- 172.21.15.43:0/1291029395 wait complete. 2024-06-13T11:37:27.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:27.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.570+0000 7f5af83a9640 1 Processor -- start 2024-06-13T11:37:27.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.570+0000 7f5af83a9640 1 -- start start 2024-06-13T11:37:27.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af83a9640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5af00cf580 0x7f5af0071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af83a9640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00b09f0 con 0x7f5af0072b90 2024-06-13T11:37:27.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af83a9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af0071dd0 con 0x7f5af015c250 2024-06-13T11:37:27.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af83a9640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5af0072700 con 0x7f5af00cf580 2024-06-13T11:37:27.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af5944640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5af00cf580 0x7f5af0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af6946640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5af0072b90 0x7f5af00a9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53048/0 (socket says 172.21.15.43:53048) 2024-06-13T11:37:27.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af5944640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5af00cf580 0x7f5af0071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47804/0 (socket says 172.21.15.43:47804) 2024-06-13T11:37:27.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.571+0000 7f5af6946640 1 -- 172.21.15.43:0/1918539996 learned_addr learned my addr 172.21.15.43:0/1918539996 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:27.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.572+0000 7f5af5944640 1 -- 172.21.15.43:0/1918539996 >> v1:172.21.15.53:6789/0 conn(0x7f5af015c250 legacy=0x7f5af00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:27.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.572+0000 7f5af5143640 1 -- 172.21.15.43:0/1918539996 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261756261 0 0) 0x7f5af00b09f0 con 0x7f5af0072b90 2024-06-13T11:37:27.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.572+0000 7f5af5944640 1 -- 172.21.15.43:0/1918539996 >> v1:172.21.15.43:6789/0 conn(0x7f5af0072b90 legacy=0x7f5af00a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.572+0000 7f5af5944640 1 -- 172.21.15.43:0/1918539996 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00720b0 con 0x7f5af00cf580 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.572+0000 7f5af5944640 1 --2- 172.21.15.43:0/1918539996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af00cf580 0x7f5af0071220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40097a0 tx=0x7f5ae402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41f015a8eab0d52 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af5143640 1 -- 172.21.15.43:0/1918539996 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4037070 con 0x7f5af00cf580 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af5143640 1 -- 172.21.15.43:0/1918539996 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae4032440 con 0x7f5af00cf580 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af5143640 1 -- 172.21.15.43:0/1918539996 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4032810 con 0x7f5af00cf580 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 -- 172.21.15.43:0/1918539996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af00cf580 msgr2=0x7f5af0071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 --2- 172.21.15.43:0/1918539996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af00cf580 0x7f5af0071220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40097a0 tx=0x7f5ae402a230 comp rx=0 tx=0).stop 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 -- 172.21.15.43:0/1918539996 shutdown_connections 2024-06-13T11:37:27.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 --2- 172.21.15.43:0/1918539996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af00cf580 0x7f5af0071220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 -- 172.21.15.43:0/1918539996 >> 172.21.15.43:0/1918539996 conn(0x7f5af00b14b0 msgr2=0x7f5af00b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:27.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 -- 172.21.15.43:0/1918539996 shutdown_connections 2024-06-13T11:37:27.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.573+0000 7f5af83a9640 1 -- 172.21.15.43:0/1918539996 wait complete. 2024-06-13T11:37:27.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.574+0000 7f5af83a9640 1 Processor -- start 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.574+0000 7f5af83a9640 1 -- start start 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af83a9640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5af0072b90 0x7f5af0149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af83a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af00cf580 0x7f5af0146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af83a9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 0x7f5af00c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af83a9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5af015c7b0 con 0x7f5af015c250 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af83a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5af015c630 con 0x7f5af00cf580 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af83a9640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00b0e30 con 0x7f5af0072b90 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af6946640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 0x7f5af00c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af6946640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 0x7f5af00c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47810/0 (socket says 172.21.15.43:47810) 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af6946640 1 -- 172.21.15.43:0/2717822112 learned_addr learned my addr 172.21.15.43:0/2717822112 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af5944640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af00cf580 0x7f5af0146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.575+0000 7f5af6145640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5af0072b90 0x7f5af0149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af6946640 1 -- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5af0072b90 msgr2=0x7f5af0149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af6946640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5af0072b90 0x7f5af0149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af6946640 1 -- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af00cf580 msgr2=0x7f5af0146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af6946640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af00cf580 0x7f5af0146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af6946640 1 -- 172.21.15.43:0/2717822112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af01474b0 con 0x7f5af015c250 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af6946640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 0x7f5af00c8150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c800 tx=0x7f5ae000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0018070 con 0x7f5af015c250 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0004d80 con 0x7f5af015c250 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af0149e20 con 0x7f5af015c250 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000a880 con 0x7f5af015c250 2024-06-13T11:37:27.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.576+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af014a3e0 con 0x7f5af015c250 2024-06-13T11:37:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.577+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af004ffb0 con 0x7f5af015c250 2024-06-13T11:37:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.577+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ae001b070 con 0x7f5af015c250 2024-06-13T11:37:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.578+0000 7f5aeeffd640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5adc06be30 0x7f5adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.578+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae008a6a0 con 0x7f5af015c250 2024-06-13T11:37:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.578+0000 7f5af6145640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5adc06be30 0x7f5adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.579+0000 7f5af6145640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5adc06be30 0x7f5adc06e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80016e0 tx=0x7f5ae8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.582+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ae0058780 con 0x7f5af015c250 2024-06-13T11:37:27.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.803+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5af00b4ba0 con 0x7f5af015c250 2024-06-13T11:37:27.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.803+0000 7f5aeeffd640 1 -- 172.21.15.43:0/2717822112 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f5ae005ca80 con 0x7f5af015c250 2024-06-13T11:37:27.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:27.803 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:27.803 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5adc06be30 msgr2=0x7f5adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5adc06be30 0x7f5adc06e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80016e0 tx=0x7f5ae8009040 comp rx=0 tx=0).stop 2024-06-13T11:37:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 msgr2=0x7f5af00c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 0x7f5af00c8150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c800 tx=0x7f5ae000ccc0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 shutdown_connections 2024-06-13T11:37:27.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5adc06be30 0x7f5adc06e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af015c250 0x7f5af00c8150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af00cf580 0x7f5af0146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 --2- 172.21.15.43:0/2717822112 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5af0072b90 0x7f5af0149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 >> 172.21.15.43:0/2717822112 conn(0x7f5af00b14b0 msgr2=0x7f5af006db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:27.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 shutdown_connections 2024-06-13T11:37:27.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.806+0000 7f5af83a9640 1 -- 172.21.15.43:0/2717822112 wait complete. 2024-06-13T11:37:27.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:27.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.923+0000 7f5492a4c640 1 Processor -- start 2024-06-13T11:37:27.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.923+0000 7f5492a4c640 1 -- start start 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f5492a4c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f548c155420 0x7f548c0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f5492a4c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c0ae9c0 0x7f548c0d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f5492a4c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548c0aa5d0 con 0x7f548c0d2fd0 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f5492a4c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f548c155800 con 0x7f548c155420 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f5492a4c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f548c0ace10 con 0x7f548c0ae9c0 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f548c155420 0x7f548c0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f548c155420 0x7f548c0ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47822/0 (socket says 172.21.15.43:47822) 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 -- 172.21.15.43:0/4045535511 learned_addr learned my addr 172.21.15.43:0/4045535511 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548b7fe640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c0ae9c0 0x7f548c0d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 -- 172.21.15.43:0/4045535511 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c0ae9c0 msgr2=0x7f548c0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c0ae9c0 0x7f548c0d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 -- 172.21.15.43:0/4045535511 >> v1:172.21.15.53:6789/0 conn(0x7f548c0d2fd0 legacy=0x7f548c161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548bfff640 1 -- 172.21.15.43:0/4045535511 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c0aa870 con 0x7f548c155420 2024-06-13T11:37:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.924+0000 7f548b7fe640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c0ae9c0 0x7f548c0d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.925+0000 7f548bfff640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c155420 0x7f548c0ae480 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f547c009870 tx=0x7f547c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9cc07225cb4d29 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.925+0000 7f548affd640 1 -- 172.21.15.43:0/4045535511 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c037070 con 0x7f548c155420 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.925+0000 7f548affd640 1 -- 172.21.15.43:0/4045535511 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547c032440 con 0x7f548c155420 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.925+0000 7f548affd640 1 -- 172.21.15.43:0/4045535511 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c032810 con 0x7f548c155420 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 -- 172.21.15.43:0/4045535511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c155420 msgr2=0x7f548c0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c155420 0x7f548c0ae480 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f547c009870 tx=0x7f547c02a200 comp rx=0 tx=0).stop 2024-06-13T11:37:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 -- 172.21.15.43:0/4045535511 shutdown_connections 2024-06-13T11:37:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c0ae9c0 0x7f548c0d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 --2- 172.21.15.43:0/4045535511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c155420 0x7f548c0ae480 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 -- 172.21.15.43:0/4045535511 >> 172.21.15.43:0/4045535511 conn(0x7f548c067640 msgr2=0x7f548c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 -- 172.21.15.43:0/4045535511 shutdown_connections 2024-06-13T11:37:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.926+0000 7f5492a4c640 1 -- 172.21.15.43:0/4045535511 wait complete. 2024-06-13T11:37:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.927+0000 7f5492a4c640 1 Processor -- start 2024-06-13T11:37:27.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.927+0000 7f5492a4c640 1 -- start start 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5492a4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f548c0ae9c0 0x7f548c14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5492a4c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 0x7f548c153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5492a4c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c155420 0x7f548c15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5492a4c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f548c0ab110 con 0x7f548c0d2fd0 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5492a4c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f548c0aae30 con 0x7f548c0ae9c0 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5492a4c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f548c0ab630 con 0x7f548c155420 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f548b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 0x7f548c153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f548b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 0x7f548c153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47830/0 (socket says 172.21.15.43:47830) 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f548b7fe640 1 -- 172.21.15.43:0/324094441 learned_addr learned my addr 172.21.15.43:0/324094441 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f5490fe9640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c155420 0x7f548c15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f548b7fe640 1 -- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c155420 msgr2=0x7f548c15c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.928+0000 7f548b7fe640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c155420 0x7f548c15c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f548bfff640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f548c0ae9c0 0x7f548c14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f548b7fe640 1 -- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f548c0ae9c0 msgr2=0x7f548c14b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f548b7fe640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f548c0ae9c0 0x7f548c14b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f548b7fe640 1 -- 172.21.15.43:0/324094441 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c13e7b0 con 0x7f548c0d2fd0 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f548b7fe640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 0x7f548c153d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f548000c7f0 tx=0x7f548000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480015070 con 0x7f548c0d2fd0 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5480007a30 con 0x7f548c0d2fd0 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c13ea90 con 0x7f548c0d2fd0 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480007e00 con 0x7f548c0d2fd0 2024-06-13T11:37:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.929+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c13f050 con 0x7f548c0d2fd0 2024-06-13T11:37:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.930+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548c04ffb0 con 0x7f548c0d2fd0 2024-06-13T11:37:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.930+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5480018070 con 0x7f548c0d2fd0 2024-06-13T11:37:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.931+0000 7f5488ff9640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f547806be30 0x7f547806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.931+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f548008b190 con 0x7f548c0d2fd0 2024-06-13T11:37:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.931+0000 7f548bfff640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f547806be30 0x7f547806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.932+0000 7f548bfff640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f547806be30 0x7f547806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f547c034000 tx=0x7f547c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:27.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:27.935+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5480059800 con 0x7f548c0d2fd0 2024-06-13T11:37:28.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.121+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f548c0ab920 con 0x7f548c0d2fd0 2024-06-13T11:37:28.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.122+0000 7f5488ff9640 1 -- 172.21.15.43:0/324094441 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f5480059100 con 0x7f548c0d2fd0 2024-06-13T11:37:28.121 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:28.121 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:28.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f547806be30 msgr2=0x7f547806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f547806be30 0x7f547806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f547c034000 tx=0x7f547c02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:28.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 msgr2=0x7f548c153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 0x7f548c153d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f548000c7f0 tx=0x7f548000cbf0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 shutdown_connections 2024-06-13T11:37:28.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f547806be30 0x7f547806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f548c155420 0x7f548c15c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f548c0d2fd0 0x7f548c153d20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 --2- 172.21.15.43:0/324094441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f548c0ae9c0 0x7f548c14b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 >> 172.21.15.43:0/324094441 conn(0x7f548c067640 msgr2=0x7f548c0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:28.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 shutdown_connections 2024-06-13T11:37:28.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.124+0000 7f5492a4c640 1 -- 172.21.15.43:0/324094441 wait complete. 2024-06-13T11:37:28.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:28.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.239+0000 7fc486bd5640 1 Processor -- start 2024-06-13T11:37:28.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.239+0000 7fc486bd5640 1 -- start start 2024-06-13T11:37:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc486bd5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4800b6a70 0x7fc48015f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc486bd5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:28.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc486bd5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc480071d50 con 0x7fc4800b78a0 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc486bd5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc48015ef90 con 0x7fc4800b6a70 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc486bd5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc480162a00 con 0x7fc480162530 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4800b6a70 0x7fc48015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4800b6a70 0x7fc48015f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47832/0 (socket says 172.21.15.43:47832) 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 -- 172.21.15.43:0/1430145595 learned_addr learned my addr 172.21.15.43:0/1430145595 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc485172640 1 --2- 172.21.15.43:0/1430145595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 -- 172.21.15.43:0/1430145595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 msgr2=0x7fc4800b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 --2- 172.21.15.43:0/1430145595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 -- 172.21.15.43:0/1430145595 >> v1:172.21.15.53:6789/0 conn(0x7fc4800b78a0 legacy=0x7fc480161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.240+0000 7fc484971640 1 -- 172.21.15.43:0/1430145595 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc480162ce0 con 0x7fc4800b6a70 2024-06-13T11:37:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.241+0000 7fc484971640 1 --2- 172.21.15.43:0/1430145595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48015f420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009870 tx=0x7fc47c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d404f2185153ee8d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.241+0000 7fc4777fe640 1 -- 172.21.15.43:0/1430145595 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c037070 con 0x7fc4800b6a70 2024-06-13T11:37:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.241+0000 7fc4777fe640 1 -- 172.21.15.43:0/1430145595 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47c032440 con 0x7fc4800b6a70 2024-06-13T11:37:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.241+0000 7fc4777fe640 1 -- 172.21.15.43:0/1430145595 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c032810 con 0x7fc4800b6a70 2024-06-13T11:37:28.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 -- 172.21.15.43:0/1430145595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 msgr2=0x7fc48015f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 --2- 172.21.15.43:0/1430145595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48015f420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009870 tx=0x7fc47c02a1c0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 -- 172.21.15.43:0/1430145595 shutdown_connections 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 --2- 172.21.15.43:0/1430145595 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 --2- 172.21.15.43:0/1430145595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48015f420 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 -- 172.21.15.43:0/1430145595 >> 172.21.15.43:0/1430145595 conn(0x7fc48006f110 msgr2=0x7fc48006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 -- 172.21.15.43:0/1430145595 shutdown_connections 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.242+0000 7fc486bd5640 1 -- 172.21.15.43:0/1430145595 wait complete. 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.243+0000 7fc486bd5640 1 Processor -- start 2024-06-13T11:37:28.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.243+0000 7fc486bd5640 1 -- start start 2024-06-13T11:37:28.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc486bd5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:28.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc486bd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4800b78a0 0x7fc4801f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:28.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc486bd5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:28.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc486bd5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800b6e50 con 0x7fc4800b6a70 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc486bd5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc48015ec20 con 0x7fc4800b78a0 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc486bd5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc4800b5390 con 0x7fc480162530 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48014ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47836/0 (socket says 172.21.15.43:47836) 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 -- 172.21.15.43:0/4047777754 learned_addr learned my addr 172.21.15.43:0/4047777754 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc477fff640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4800b78a0 0x7fc4801f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 -- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 msgr2=0x7fc4800cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc485172640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 -- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4800b78a0 msgr2=0x7fc4801f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4800b78a0 0x7fc4801f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.244+0000 7fc484971640 1 -- 172.21.15.43:0/4047777754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4801e8de0 con 0x7fc4800b6a70 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc477fff640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4800b78a0 0x7fc4801f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc484971640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48014ade0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc47c02a200 tx=0x7fc47c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:28.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c037040 con 0x7fc4800b6a70 2024-06-13T11:37:28.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47c042070 con 0x7fc4800b6a70 2024-06-13T11:37:28.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4801e90c0 con 0x7fc4800b6a70 2024-06-13T11:37:28.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c030880 con 0x7fc4800b6a70 2024-06-13T11:37:28.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.245+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4801e9680 con 0x7fc4800b6a70 2024-06-13T11:37:28.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.246+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48004ffb0 con 0x7fc4800b6a70 2024-06-13T11:37:28.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.246+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc47c02ad10 con 0x7fc4800b6a70 2024-06-13T11:37:28.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.247+0000 7fc4757fa640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc46c06be60 0x7fc46c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:28.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.247+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc47c0ab860 con 0x7fc4800b6a70 2024-06-13T11:37:28.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.247+0000 7fc477fff640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc46c06be60 0x7fc46c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:28.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.248+0000 7fc477fff640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc46c06be60 0x7fc46c06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4800cba30 tx=0x7fc470009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:28.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.251+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc47c079da0 con 0x7fc4800b6a70 2024-06-13T11:37:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.475+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4800b8180 con 0x7fc4800b6a70 2024-06-13T11:37:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.475+0000 7fc4757fa640 1 -- 172.21.15.43:0/4047777754 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fc47c0796a0 con 0x7fc4800b6a70 2024-06-13T11:37:28.475 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:28.475 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.477+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc46c06be60 msgr2=0x7fc46c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.477+0000 7fc486bd5640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc46c06be60 0x7fc46c06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4800cba30 tx=0x7fc470009040 comp rx=0 tx=0).stop 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 msgr2=0x7fc48014ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48014ade0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc47c02a200 tx=0x7fc47c0046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 shutdown_connections 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc46c06be60 0x7fc46c06e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc480162530 0x7fc4800cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4800b78a0 0x7fc4801f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 --2- 172.21.15.43:0/4047777754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4800b6a70 0x7fc48014ade0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 >> 172.21.15.43:0/4047777754 conn(0x7fc48006f110 msgr2=0x7fc4800b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 shutdown_connections 2024-06-13T11:37:28.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:28.478+0000 7fc486bd5640 1 -- 172.21.15.43:0/4047777754 wait complete. 2024-06-13T11:37:28.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-13T11:37:07.166526+0000', 'modified': '2024-06-13T11:37:20.214302+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3684318911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3684318911}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3684318911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-06-13T11:37:28.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-13T11:37:28.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-13T11:37:28.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.000+0000 7f22589d5640 1 Processor -- start 2024-06-13T11:37:28.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.000+0000 7f22589d5640 1 -- start start 2024-06-13T11:37:29.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.000+0000 7f22589d5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f22540d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.000+0000 7f22589d5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f22540abe00 0x7f22540ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.000+0000 7f22589d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22540aa5d0 con 0x7f2254155420 2024-06-13T11:37:29.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f22589d5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f22540d3410 con 0x7f22540abe00 2024-06-13T11:37:29.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f22589d5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f22540aeb90 con 0x7f22540d2a90 2024-06-13T11:37:29.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f22540abe00 0x7f22540ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f22540abe00 0x7f22540ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47850/0 (socket says 172.21.15.43:47850) 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 -- 172.21.15.43:0/811766244 learned_addr learned my addr 172.21.15.43:0/811766244 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f224bfff640 1 --2- 172.21.15.43:0/811766244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f22540d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 -- 172.21.15.43:0/811766244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 msgr2=0x7f22540d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 --2- 172.21.15.43:0/811766244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f22540d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 -- 172.21.15.43:0/811766244 >> v1:172.21.15.53:6789/0 conn(0x7f2254155420 legacy=0x7f22540ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.001+0000 7f2252d9d640 1 -- 172.21.15.43:0/811766244 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2254155800 con 0x7f22540abe00 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f2252d9d640 1 --2- 172.21.15.43:0/811766244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22540abe00 0x7f22540ac240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f224c009e50 tx=0x7f224c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a23859c5ba5ab9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f2251d9b640 1 -- 172.21.15.43:0/811766244 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c036070 con 0x7f22540abe00 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f2251d9b640 1 -- 172.21.15.43:0/811766244 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c031600 con 0x7f22540abe00 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f2251d9b640 1 -- 172.21.15.43:0/811766244 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c0319d0 con 0x7f22540abe00 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 -- 172.21.15.43:0/811766244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22540abe00 msgr2=0x7f22540ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 --2- 172.21.15.43:0/811766244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22540abe00 0x7f22540ac240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f224c009e50 tx=0x7f224c02a710 comp rx=0 tx=0).stop 2024-06-13T11:37:29.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 -- 172.21.15.43:0/811766244 shutdown_connections 2024-06-13T11:37:29.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 --2- 172.21.15.43:0/811766244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22540abe00 0x7f22540ac240 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 --2- 172.21.15.43:0/811766244 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f22540d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 -- 172.21.15.43:0/811766244 >> 172.21.15.43:0/811766244 conn(0x7f2254067640 msgr2=0x7f22540d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 -- 172.21.15.43:0/811766244 shutdown_connections 2024-06-13T11:37:29.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.002+0000 7f22589d5640 1 -- 172.21.15.43:0/811766244 wait complete. 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.004+0000 7f22589d5640 1 Processor -- start 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.004+0000 7f22589d5640 1 -- start start 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.004+0000 7f22589d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22540abe00 0x7f22541f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f225414b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 0x7f2254157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22540aae30 con 0x7f2254155420 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f22540aab50 con 0x7f22540abe00 2024-06-13T11:37:29.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f22540ab110 con 0x7f22540d2a90 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 0x7f2254157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 0x7f2254157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47860/0 (socket says 172.21.15.43:47860) 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 -- 172.21.15.43:0/2170230077 learned_addr learned my addr 172.21.15.43:0/2170230077 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f225259c640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22540abe00 0x7f22541f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f224bfff640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f225414b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 -- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 msgr2=0x7f225414b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f225414b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 -- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22540abe00 msgr2=0x7f22541f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22540abe00 0x7f22541f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 -- 172.21.15.43:0/2170230077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22541583c0 con 0x7f2254155420 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f224bfff640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f225414b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f2252d9d640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 0x7f2254157e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f224c009e50 tx=0x7f224c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f224affd640 1 -- 172.21.15.43:0/2170230077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c036050 con 0x7f2254155420 2024-06-13T11:37:29.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f224affd640 1 -- 172.21.15.43:0/2170230077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c042070 con 0x7f2254155420 2024-06-13T11:37:29.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2254156de0 con 0x7f2254155420 2024-06-13T11:37:29.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f224affd640 1 -- 172.21.15.43:0/2170230077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c009510 con 0x7f2254155420 2024-06-13T11:37:29.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.005+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541573a0 con 0x7f2254155420 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.007+0000 7f224affd640 1 -- 172.21.15.43:0/2170230077 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f224c007bd0 con 0x7f2254155420 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.008+0000 7f224affd640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f223406be30 0x7f223406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.008+0000 7f224affd640 1 -- 172.21.15.43:0/2170230077 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f224c0abf80 con 0x7f2254155420 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.008+0000 7f225259c640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f223406be30 0x7f223406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.008+0000 7f225259c640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f223406be30 0x7f223406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2244007fd0 tx=0x7f2244009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.009+0000 7f225b7b7740 1 Processor -- start 2024-06-13T11:37:29.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.009+0000 7f225b7b7740 1 -- start start 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2c5990 0x55b01c2c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225b7b7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b01c22e740 con 0x55b01c2f2d30 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b01c1cca80 con 0x55b01c2f3110 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x55b01c22a700 con 0x55b01c2c5990 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47874/0 (socket says 172.21.15.43:47874) 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 -- 172.21.15.43:0/4060772752 learned_addr learned my addr 172.21.15.43:0/4060772752 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f224bfff640 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f2252d9d640 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2c5990 0x55b01c2c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 -- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2c5990 msgr2=0x55b01c2c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2c5990 0x55b01c2c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 -- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 msgr2=0x55b01c2f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 -- 172.21.15.43:0/4060772752 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01c1f7fb0 con 0x55b01c2f2d30 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f225259c640 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2f5540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f22440052a0 tx=0x7f2244011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4929b6ab7ec7af0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f2233fff640 1 -- 172.21.15.43:0/4060772752 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244021450 con 0x55b01c2f2d30 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f2233fff640 1 -- 172.21.15.43:0/4060772752 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22440215f0 con 0x55b01c2f2d30 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.010+0000 7f2233fff640 1 -- 172.21.15.43:0/4060772752 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440219a0 con 0x55b01c2f2d30 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 -- 172.21.15.43:0/4060772752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 msgr2=0x55b01c2f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2f5540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f22440052a0 tx=0x7f2244011000 comp rx=0 tx=0).stop 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 -- 172.21.15.43:0/4060772752 shutdown_connections 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2c5990 0x55b01c2c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 --2- 172.21.15.43:0/4060772752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2f5540 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 -- 172.21.15.43:0/4060772752 >> 172.21.15.43:0/4060772752 conn(0x55b01c2c7c00 msgr2=0x55b01c310540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 -- 172.21.15.43:0/4060772752 shutdown_connections 2024-06-13T11:37:29.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.011+0000 7f225b7b7740 1 -- 172.21.15.43:0/4060772752 wait complete. 2024-06-13T11:37:29.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.012+0000 7f225b7b7740 1 -- start start 2024-06-13T11:37:29.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.012+0000 7f225b7b7740 1 Processor -- start 2024-06-13T11:37:29.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c3122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 0x55b01c3096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b01c2cadb0 con 0x55b01c309270 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b01c1b7c30 con 0x55b01c2f3110 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x55b01c2cb090 con 0x55b01c2f2d30 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 10 client.0 _ll_register_callbacks cb 0x55b01c1e97f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 0x55b01c3096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 0x55b01c3096f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47876/0 (socket says 172.21.15.43:47876) 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 -- 172.21.15.43:0/1317160117 learned_addr learned my addr 172.21.15.43:0/1317160117 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f224bfff640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225259c640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c3122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 -- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 msgr2=0x55b01c3122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c3122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 -- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 msgr2=0x55b01c2e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 -- 172.21.15.43:0/1317160117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01bf422d0 con 0x55b01c309270 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225259c640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c3122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f2252d9d640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 0x55b01c3096f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f224c02a750 tx=0x7f224c0316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a0c9a1dbbc26e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f22317fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f22317fa640 1 -- 172.21.15.43:0/1317160117 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c0a3d60 con 0x55b01c309270 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f22317fa640 1 -- 172.21.15.43:0/1317160117 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f224c0793d0 con 0x55b01c309270 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22440215f0 con 0x55b01c309270 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f22317fa640 1 -- 172.21.15.43:0/1317160117 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f224c07e330 con 0x55b01c309270 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 10 client.4719 fetch_fsmap learned FSMap version 9 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.013+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b01c00c6b0 con 0x55b01c309270 2024-06-13T11:37:29.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f22317fa640 1 -- 172.21.15.43:0/1317160117 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22440215f0 con 0x55b01c309270 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f22317fa640 1 -- 172.21.15.43:0/1317160117 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f224c075cd0 con 0x55b01c309270 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225b7b7740 10 client.4719 fetch_fsmap finished waiting for FSMap version 9 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225b7b7740 10 client.4719 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225b7b7740 20 client.4719 populate_metadata read hostname 'smithi043' 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225b7b7740 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c307570 0x55b01c307950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225b7b7740 4 client.4719 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 --> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b01c23be70 con 0x55b01c307570 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225259c640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c307570 0x55b01c307950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f22317fa640 10 client.4719 ms_handle_connect on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.014+0000 7f225259c640 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c307570 0x55b01c307950 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56edc0cd4a6443ab server_cookie=d15ddd138d464962 in_seq=0 out_seq=0 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f22317fa640 1 -- 172.21.15.43:0/1317160117 <== mds.0 v2:172.21.15.53:6834/3684318911 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b01c23be70 con 0x55b01c307570 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f22317fa640 10 client.4719 handle_command_reply: tid=0 2024-06-13T11:37:29.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 client.4719 shutdown 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 msgr2=0x55b01c3096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 0x55b01c3096f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f224c02a750 tx=0x7f224c0316c0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 shutdown_connections 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c307570 0x55b01c307950 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c309270 0x55b01c3096f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c2f3110 0x55b01c2e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f22317fa640 0 client.4719 ms_handle_reset on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 --2- 172.21.15.43:0/1317160117 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c3122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 >> 172.21.15.43:0/1317160117 conn(0x55b01c2c5990 msgr2=0x55b01c2ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 shutdown_connections 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.015+0000 7f225b7b7740 1 -- 172.21.15.43:0/1317160117 wait complete. 2024-06-13T11:37:29.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.016+0000 7f225b7b7740 20 client.4719 trim_cache size 0 max 16384 2024-06-13T11:37:29.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 Processor -- start 2024-06-13T11:37:29.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 -- start start 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f3110 0x55b01c30c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c30c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2254201e20 con 0x55b01c2f2d30 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2254200e20 con 0x55b01c309270 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2254200180 con 0x55b01c2f3110 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2e9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47886/0 (socket says 172.21.15.43:47886) 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.035+0000 7f225259c640 1 -- 172.21.15.43:0/3946227780 learned_addr learned my addr 172.21.15.43:0/3946227780 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f2252d9d640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c30c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f224bfff640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f3110 0x55b01c30c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f225259c640 1 -- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f3110 msgr2=0x55b01c30c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f225259c640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f3110 0x55b01c30c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f225259c640 1 -- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 msgr2=0x55b01c30c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f225259c640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c30c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f225259c640 1 -- 172.21.15.43:0/3946227780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01c30b620 con 0x55b01c2f2d30 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f2252d9d640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c30c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f224bfff640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f3110 0x55b01c30c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f225259c640 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2e9ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55b01c2cd290 tx=0x7f2244005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d4ff0016106acd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f22337fe640 1 -- 172.21.15.43:0/3946227780 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244021a60 con 0x55b01c2f2d30 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f22337fe640 1 -- 172.21.15.43:0/3946227780 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2244027040 con 0x55b01c2f2d30 2024-06-13T11:37:29.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.036+0000 7f22337fe640 1 -- 172.21.15.43:0/3946227780 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244021e60 con 0x55b01c2f2d30 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 -- 172.21.15.43:0/3946227780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 msgr2=0x55b01c2e9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2e9ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55b01c2cd290 tx=0x7f2244005000 comp rx=0 tx=0).stop 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 -- 172.21.15.43:0/3946227780 shutdown_connections 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c30c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f3110 0x55b01c30c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 --2- 172.21.15.43:0/3946227780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f2d30 0x55b01c2e9ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 -- 172.21.15.43:0/3946227780 >> 172.21.15.43:0/3946227780 conn(0x55b01c2c5990 msgr2=0x55b01c30a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 -- 172.21.15.43:0/3946227780 shutdown_connections 2024-06-13T11:37:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 -- 172.21.15.43:0/3946227780 wait complete. 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 -- start start 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.037+0000 7f225b7b7740 1 Processor -- start 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c309690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 0x55b01c310e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c2cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b01c30b3e0 con 0x55b01c2f3110 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f22542007d0 con 0x55b01c309270 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x55b01c3128c0 con 0x55b01c2f2d30 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f225b7b7740 10 client.0 _ll_register_callbacks cb 0x7f224c0798e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:37:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f224bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 0x55b01c310e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f224bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 0x55b01c310e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47890/0 (socket says 172.21.15.43:47890) 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.038+0000 7f224bfff640 1 -- 172.21.15.43:0/2302543875 learned_addr learned my addr 172.21.15.43:0/2302543875 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f2252d9d640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c2cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f225259c640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c309690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f224bfff640 1 -- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 msgr2=0x55b01c309690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f224bfff640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c309690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f224bfff640 1 -- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 msgr2=0x55b01c2cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f224bfff640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c2cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f224bfff640 1 -- 172.21.15.43:0/2302543875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01c311390 con 0x55b01c2f3110 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f224bfff640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 0x55b01c310e50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f223c009eb0 tx=0x7f223c015730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4984ce0a35d3fee6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f22317fa640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f22317fa640 1 -- 172.21.15.43:0/2302543875 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c00f040 con 0x55b01c2f3110 2024-06-13T11:37:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f22317fa640 1 -- 172.21.15.43:0/2302543875 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f223c004230 con 0x55b01c2f3110 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2244027040 con 0x55b01c2f3110 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f22317fa640 1 -- 172.21.15.43:0/2302543875 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f223c027050 con 0x55b01c2f3110 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f225b7b7740 10 client.4725 fetch_fsmap learned FSMap version 9 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.039+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b01c30fff0 con 0x55b01c2f3110 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f22317fa640 1 -- 172.21.15.43:0/2302543875 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2244027040 con 0x55b01c2f3110 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f22317fa640 1 -- 172.21.15.43:0/2302543875 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f223c02a020 con 0x55b01c2f3110 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225b7b7740 10 client.4725 fetch_fsmap finished waiting for FSMap version 9 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225b7b7740 10 client.4725 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225b7b7740 20 client.4725 populate_metadata read hostname 'smithi043' 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225b7b7740 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c308240 0x55b01c308620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225b7b7740 4 client.4725 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 --> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] -- command(tid 0: {"prefix": "status"}) -- 0x55b01c2361c0 con 0x55b01c308240 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225259c640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c308240 0x55b01c308620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f22317fa640 10 client.4725 ms_handle_connect on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.040+0000 7f225259c640 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c308240 0x55b01c308620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6ca9d956538cc96 server_cookie=63d334806eec5ba3 in_seq=0 out_seq=0 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22317fa640 1 -- 172.21.15.43:0/2302543875 <== mds.0 v2:172.21.15.53:6834/3684318911 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55b01c2361c0 con 0x55b01c308240 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22317fa640 10 client.4725 handle_command_reply: tid=0 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 client.4725 shutdown 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 msgr2=0x55b01c310e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 0x55b01c310e50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f223c009eb0 tx=0x7f223c015730 comp rx=0 tx=0).stop 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 shutdown_connections 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:6834/3684318911,v1:172.21.15.53:6835/3684318911] conn(0x55b01c308240 0x55b01c308620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b01c309270 0x55b01c2cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b01c2f3110 0x55b01c310e50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 --2- 172.21.15.43:0/2302543875 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55b01c2f2d30 0x55b01c309690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22317fa640 0 client.4725 ms_handle_reset on v2:172.21.15.53:6834/3684318911 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 >> 172.21.15.43:0/2302543875 conn(0x55b01c2c5990 msgr2=0x55b01c307950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 shutdown_connections 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 1 -- 172.21.15.43:0/2302543875 wait complete. 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f225b7b7740 20 client.4725 trim_cache size 0 max 16384 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5", 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4296, 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-06-13T11:37:29.046 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 21.243485237000002, 2024-06-13T11:37:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 9, 2024-06-13T11:37:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 25, 2024-06-13T11:37:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 25, 2024-06-13T11:37:29.047 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 27.410885179000001 2024-06-13T11:37:29.047 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-06-13T11:37:29.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f223406be30 msgr2=0x7f223406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f223406be30 0x7f223406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2244007fd0 tx=0x7f2244009040 comp rx=0 tx=0).stop 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 msgr2=0x7f2254157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 0x7f2254157e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f224c009e50 tx=0x7f224c004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 shutdown_connections 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f223406be30 0x7f223406e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2254155420 0x7f2254157e80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f22540d2a90 0x7f225414b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 --2- 172.21.15.43:0/2170230077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22540abe00 0x7f22541f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.041+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 >> 172.21.15.43:0/2170230077 conn(0x7f2254067640 msgr2=0x7f22540adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.042+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 shutdown_connections 2024-06-13T11:37:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.042+0000 7f22589d5640 1 -- 172.21.15.43:0/2170230077 wait complete. 2024-06-13T11:37:29.052 INFO:teuthology.run_tasks:Running task sequential... 2024-06-13T11:37:29.061 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-13T11:37:29.061 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-13T11:37:29.061 INFO:teuthology.task.print:Enabling mgr modules 2024-06-13T11:37:29.061 INFO:teuthology.run_tasks:Running task kclient... 2024-06-13T11:37:29.082 INFO:tasks.kclient:Mounting kernel clients... 2024-06-13T11:37:29.082 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-06-13T11:37:29.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.083 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-06-13T11:37:29.099 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-13T11:37:29.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:37:29.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-06-13T11:37:29.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.262 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-06-13T11:37:29.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-06-13T11:37:29.346 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-06-13T11:37:29.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:37:29.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.348 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-06-13T11:37:29.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-06-13T11:37:29.441 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2024-06-13T11:37:29.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:37:29.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.443 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-06-13T11:37:29.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-06-13T11:37:29.573 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2024-06-13T11:37:29.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:37:29.574 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-06-13T11:37:29.574 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:37:29.574 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T11:37:29.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-13T11:37:29.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 Processor -- start 2024-06-13T11:37:29.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 -- start start 2024-06-13T11:37:29.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f431c0cf580 0x7f431c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f431c072b90 0x7f431c0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431c0b09f0 con 0x7f431c15c250 2024-06-13T11:37:29.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f431c072700 con 0x7f431c072b90 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.682+0000 7f43217b0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f431c071dd0 con 0x7f431c0cf580 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431b7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f431c072b90 0x7f431c0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431affd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f431c15c250 0x7f431c0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53052/0 (socket says 172.21.15.43:53052) 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431affd640 1 -- 172.21.15.43:0/1461711033 learned_addr learned my addr 172.21.15.43:0/1461711033 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431a7fc640 1 --2- 172.21.15.43:0/1461711033 >> v2:172.21.15.53:3300/0 conn(0x7f431c0cf580 0x7f431c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431b7fe640 1 -- 172.21.15.43:0/1461711033 >> v2:172.21.15.53:3300/0 conn(0x7f431c0cf580 msgr2=0x7f431c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431b7fe640 1 --2- 172.21.15.43:0/1461711033 >> v2:172.21.15.53:3300/0 conn(0x7f431c0cf580 0x7f431c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431b7fe640 1 -- 172.21.15.43:0/1461711033 >> v1:172.21.15.43:6789/0 conn(0x7f431c15c250 legacy=0x7f431c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f4319ffb640 1 -- 172.21.15.43:0/1461711033 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297155278 0 0) 0x7f431c0b09f0 con 0x7f431c15c250 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431b7fe640 1 -- 172.21.15.43:0/1461711033 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c0720b0 con 0x7f431c072b90 2024-06-13T11:37:29.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.683+0000 7f431a7fc640 1 --2- 172.21.15.43:0/1461711033 >> v2:172.21.15.53:3300/0 conn(0x7f431c0cf580 0x7f431c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f431b7fe640 1 --2- 172.21.15.43:0/1461711033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c0a9490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ab380 tx=0x7f431402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fe81020597a070 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f4319ffb640 1 -- 172.21.15.43:0/1461711033 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314007740 con 0x7f431c072b90 2024-06-13T11:37:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f4319ffb640 1 -- 172.21.15.43:0/1461711033 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43140078e0 con 0x7f431c072b90 2024-06-13T11:37:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f4319ffb640 1 -- 172.21.15.43:0/1461711033 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314007cb0 con 0x7f431c072b90 2024-06-13T11:37:29.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 -- 172.21.15.43:0/1461711033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 msgr2=0x7f431c0a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 --2- 172.21.15.43:0/1461711033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c0a9490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ab380 tx=0x7f431402a680 comp rx=0 tx=0).stop 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 -- 172.21.15.43:0/1461711033 shutdown_connections 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 --2- 172.21.15.43:0/1461711033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c0a9490 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 --2- 172.21.15.43:0/1461711033 >> v2:172.21.15.53:3300/0 conn(0x7f431c0cf580 0x7f431c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 -- 172.21.15.43:0/1461711033 >> 172.21.15.43:0/1461711033 conn(0x7f431c0b14b0 msgr2=0x7f431c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 -- 172.21.15.43:0/1461711033 shutdown_connections 2024-06-13T11:37:29.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.684+0000 7f43217b0640 1 -- 172.21.15.43:0/1461711033 wait complete. 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.686+0000 7f43217b0640 1 Processor -- start 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.686+0000 7f43217b0640 1 -- start start 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f431c0cf580 0x7f431c158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f431c15c250 0x7f431c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f431c15c7b0 con 0x7f431c072b90 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f431c15c630 con 0x7f431c15c250 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f431c0b0e30 con 0x7f431c0cf580 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c1f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47910/0 (socket says 172.21.15.43:47910) 2024-06-13T11:37:29.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 -- 172.21.15.43:0/3676320241 learned_addr learned my addr 172.21.15.43:0/3676320241 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431a7fc640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f431c0cf580 0x7f431c158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431b7fe640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f431c15c250 0x7f431c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 -- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f431c0cf580 msgr2=0x7f431c158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f431c0cf580 0x7f431c158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 -- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f431c15c250 msgr2=0x7f431c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f431c15c250 0x7f431c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 -- 172.21.15.43:0/3676320241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c159550 con 0x7f431c072b90 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f431affd640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c1f1cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f430c00c430 tx=0x7f430c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c0074e0 con 0x7f431c072b90 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c0047e0 con 0x7f431c072b90 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c004bd0 con 0x7f431c072b90 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.687+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431c159830 con 0x7f431c072b90 2024-06-13T11:37:29.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.688+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431c159df0 con 0x7f431c072b90 2024-06-13T11:37:29.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.688+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f431c04ffb0 con 0x7f431c072b90 2024-06-13T11:37:29.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.689+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f430c011070 con 0x7f431c072b90 2024-06-13T11:37:29.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.689+0000 7f43037fe640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f430806be30 0x7f430806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:29.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.689+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f430c08ac30 con 0x7f431c072b90 2024-06-13T11:37:29.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.690+0000 7f431a7fc640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f430806be30 0x7f430806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:29.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.690+0000 7f431a7fc640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f430806be30 0x7f430806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f431c1f62d0 tx=0x7f4310008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:29.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.694+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f430c058ce0 con 0x7f431c072b90 2024-06-13T11:37:29.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.916+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f431c0b33e0 con 0x7f431c072b90 2024-06-13T11:37:29.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.916+0000 7f43037fe640 1 -- 172.21.15.43:0/3676320241 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f430c05cfe0 con 0x7f431c072b90 2024-06-13T11:37:29.916 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f430806be30 msgr2=0x7f430806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f430806be30 0x7f430806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f431c1f62d0 tx=0x7f4310008040 comp rx=0 tx=0).stop 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 msgr2=0x7f431c1f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c1f1cb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f430c00c430 tx=0x7f430c00c8f0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 shutdown_connections 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f430806be30 0x7f430806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f431c15c250 0x7f431c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f431c0cf580 0x7f431c158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 --2- 172.21.15.43:0/3676320241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f431c072b90 0x7f431c1f1cb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.918+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 >> 172.21.15.43:0/3676320241 conn(0x7f431c0b14b0 msgr2=0x7f431c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:29.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.919+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 shutdown_connections 2024-06-13T11:37:29.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:29.919+0000 7f43217b0640 1 -- 172.21.15.43:0/3676320241 wait complete. 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:37:29.929 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:37:29.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:29.929 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-06-13T11:37:29.945 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:29.945 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:29.946 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42707sec preferred_lft 42707sec 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:29.947 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-06-13T11:37:29.947 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T11:37:29.947 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:29.947 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:29.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-06-13T11:37:29.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-06-13T11:37:29.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-06-13T11:37:29.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T11:37:29.948 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:30.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:30.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:30.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:30.088 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:37:30.113 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-06-13T11:37:30.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:30.115 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-06-13T11:37:30.172 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-06-13T11:37:30.172 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:37:30.172 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:37:30.172 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:37:30.172 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:37:30.173 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:30.173 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:30.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:37:30.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:37:30.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:37:30.173 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:30.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:30.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:30.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:30.303 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-06-13T11:37:30.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:30.319 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-06-13T11:37:30.374 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:30.375 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:30.375 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T11:37:30.375 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-13T11:37:30.375 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:30.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:30.495 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-13T11:37:30.495 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:30.495 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:30.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-13T11:37:30.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T11:37:30.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-13T11:37:30.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-13T11:37:30.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-13T11:37:30.496 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:30.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:30.613 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:30.613 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:30.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-06-13T11:37:30.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T11:37:30.613 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:30.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:30.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:30.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:30.693 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-13T11:37:30.708 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:37:30.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:30.708 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-13T11:37:30.763 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-06-13T11:37:30.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:30.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:30.849 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:30.849 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:31.002 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:31.002 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:31.002 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.53:3300,172.21.15.53:3301" 2024-06-13T11:37:31.002 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.cephfs=/ 2024-06-13T11:37:31.002 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2024-06-13T11:37:31.003 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-13T11:37:31.003 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-06-13T11:37:31.003 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T11:37:31.003 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T11:37:31.003 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T11:37:31.005 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T11:37:31.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:31.005 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-13T11:37:31.031 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:31.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:31.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:31.129 INFO:teuthology.orchestra.run.smithi043.stdout:client4615 2024-06-13T11:37:31.129 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:31.129 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:31.145 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:31.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:31.242 INFO:teuthology.orchestra.run.smithi043.stdout:client4615 2024-06-13T11:37:31.242 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:31.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:31.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:31.300 INFO:teuthology.orchestra.run.smithi043.stdout:client4615 2024-06-13T11:37:31.300 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.client4615/status') 2024-06-13T11:37:31.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:31.360 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4615 (3)172.21.15.43:0/775405307 2024-06-13T11:37:31.360 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-06-13T11:37:31.361 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-06-13T11:37:31.361 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-06-13T11:37:31.361 INFO:teuthology.orchestra.run.smithi043.stderr:69 bytes copied, 2.3625e-05 s, 2.9 MB/s 2024-06-13T11:37:31.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:31.368 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-06-13T11:37:31.368 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:37:31.368 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-13T11:37:31.368 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-13T11:37:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.472+0000 7f932043f640 1 Processor -- start 2024-06-13T11:37:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.472+0000 7f932043f640 1 -- start start 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f932043f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9318155420 0x7f93180ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f932043f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f93180d31a0 0x7f93180abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f932043f640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93180aa5d0 con 0x7f93180ae9c0 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f932043f640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f9318155800 con 0x7f93180d31a0 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f932043f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f93180aa870 con 0x7f9318155420 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f931e9dc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f93180d31a0 0x7f93180abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f931d9da640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f93180ae9c0 0x7f93180d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53056/0 (socket says 172.21.15.43:53056) 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.473+0000 7f931d9da640 1 -- 172.21.15.43:0/2454796262 learned_addr learned my addr 172.21.15.43:0/2454796262 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931e1db640 1 --2- 172.21.15.43:0/2454796262 >> v2:172.21.15.53:3300/0 conn(0x7f9318155420 0x7f93180ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931e9dc640 1 -- 172.21.15.43:0/2454796262 >> v2:172.21.15.53:3300/0 conn(0x7f9318155420 msgr2=0x7f93180ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931e9dc640 1 --2- 172.21.15.43:0/2454796262 >> v2:172.21.15.53:3300/0 conn(0x7f9318155420 0x7f93180ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931e9dc640 1 -- 172.21.15.43:0/2454796262 >> v1:172.21.15.43:6789/0 conn(0x7f93180ae9c0 legacy=0x7f93180d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931e9dc640 1 -- 172.21.15.43:0/2454796262 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93180aab50 con 0x7f93180d31a0 2024-06-13T11:37:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931d1d9640 1 -- 172.21.15.43:0/2454796262 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735918928 0 0) 0x7f93180aa5d0 con 0x7f93180ae9c0 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.474+0000 7f931e9dc640 1 --2- 172.21.15.43:0/2454796262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93180d31a0 0x7f93180abe00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f931815e940 tx=0x7f930802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da94b38d46e9b9d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f931d1d9640 1 -- 172.21.15.43:0/2454796262 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308007740 con 0x7f93180d31a0 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f931d1d9640 1 -- 172.21.15.43:0/2454796262 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93080078e0 con 0x7f93180d31a0 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f931d1d9640 1 -- 172.21.15.43:0/2454796262 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308007cb0 con 0x7f93180d31a0 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 -- 172.21.15.43:0/2454796262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93180d31a0 msgr2=0x7f93180abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 --2- 172.21.15.43:0/2454796262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93180d31a0 0x7f93180abe00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f931815e940 tx=0x7f930802a660 comp rx=0 tx=0).stop 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 -- 172.21.15.43:0/2454796262 shutdown_connections 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 --2- 172.21.15.43:0/2454796262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93180d31a0 0x7f93180abe00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 --2- 172.21.15.43:0/2454796262 >> v2:172.21.15.53:3300/0 conn(0x7f9318155420 0x7f93180ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 -- 172.21.15.43:0/2454796262 >> 172.21.15.43:0/2454796262 conn(0x7f9318067640 msgr2=0x7f93180d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 -- 172.21.15.43:0/2454796262 shutdown_connections 2024-06-13T11:37:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.475+0000 7f932043f640 1 -- 172.21.15.43:0/2454796262 wait complete. 2024-06-13T11:37:31.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 Processor -- start 2024-06-13T11:37:31.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 -- start start 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93180ae9c0 0x7f931815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f93180d31a0 0x7f93181470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 0x7f93181559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f93180ab630 con 0x7f9318155420 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f93180ab110 con 0x7f93180ae9c0 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f932043f640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f93180adfb0 con 0x7f93180d31a0 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f931e9dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 0x7f93181559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f931e9dc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 0x7f93181559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47940/0 (socket says 172.21.15.43:47940) 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.477+0000 7f931e9dc640 1 -- 172.21.15.43:0/4161911942 learned_addr learned my addr 172.21.15.43:0/4161911942 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e1db640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93180ae9c0 0x7f931815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931d9da640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f93180d31a0 0x7f93181470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e9dc640 1 -- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f93180d31a0 msgr2=0x7f93181470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e9dc640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f93180d31a0 0x7f93181470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e9dc640 1 -- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93180ae9c0 msgr2=0x7f931815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e9dc640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93180ae9c0 0x7f931815faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e9dc640 1 -- 172.21.15.43:0/4161911942 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9318156350 con 0x7f9318155420 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e1db640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93180ae9c0 0x7f931815faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f931e9dc640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 0x7f93181559e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f930802ac50 tx=0x7f9308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308040070 con 0x7f9318155420 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9308031bc0 con 0x7f9318155420 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9318156630 con 0x7f9318155420 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308045460 con 0x7f9318155420 2024-06-13T11:37:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.478+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9318159eb0 con 0x7f9318155420 2024-06-13T11:37:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.479+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931804ffb0 con 0x7f9318155420 2024-06-13T11:37:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.480+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9308039040 con 0x7f9318155420 2024-06-13T11:37:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.480+0000 7f9316ffd640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f930406be60 0x7f930406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.481+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f93080acbf0 con 0x7f9318155420 2024-06-13T11:37:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.481+0000 7f931e1db640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f930406be60 0x7f930406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.481+0000 7f931e1db640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f930406be60 0x7f930406e320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9310006fd0 tx=0x7f9310008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:31.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.485+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f930807b130 con 0x7f9318155420 2024-06-13T11:37:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.711+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f93180d3db0 con 0x7f9318155420 2024-06-13T11:37:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.711+0000 7f9316ffd640 1 -- 172.21.15.43:0/4161911942 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f930807aa30 con 0x7f9318155420 2024-06-13T11:37:31.710 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f930406be60 msgr2=0x7f930406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f930406be60 0x7f930406e320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9310006fd0 tx=0x7f9310008040 comp rx=0 tx=0).stop 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 msgr2=0x7f93181559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 0x7f93181559e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f930802ac50 tx=0x7f9308004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 shutdown_connections 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f930406be60 0x7f930406e320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9318155420 0x7f93181559e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f93180d31a0 0x7f93181470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 --2- 172.21.15.43:0/4161911942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93180ae9c0 0x7f931815faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:31.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.713+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 >> 172.21.15.43:0/4161911942 conn(0x7f9318067640 msgr2=0x7f931815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:31.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.714+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 shutdown_connections 2024-06-13T11:37:31.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31.714+0000 7f932043f640 1 -- 172.21.15.43:0/4161911942 wait complete. 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:37:31.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-06-13T11:37:31.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:31.725 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:31.741 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42705sec preferred_lft 42705sec 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:31.742 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 3a:47:4e:9e:6f:1a brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::185d:cbff:fe91:5711/64 scope link tentative 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 3a:47:4e:9e:6f:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::3847:4eff:fe9e:6f1a/64 scope link tentative 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:31.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:31.743 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:37:31.807 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-06-13T11:37:31.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:31.809 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-06-13T11:37:31.865 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-06-13T11:37:31.866 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:37:31.866 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:37:31.866 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:37:31.866 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:37:31.866 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:31.866 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:31.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:37:31.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:37:31.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:37:31.866 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:31.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:31.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:31.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:31.996 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-06-13T11:37:32.012 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-13T11:37:32.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:32.012 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-06-13T11:37:32.068 INFO:teuthology.orchestra.run.smithi043.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-06-13T11:37:32.068 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:32.068 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:32.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-13T11:37:32.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-06-13T11:37:32.068 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:32.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:32.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:32.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-13T11:37:32.213 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:32.213 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:32.213 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:32.213 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.213 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:32.213 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.214 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:37:32.214 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 7e:7b:8a:cd:e1:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-13T11:37:32.214 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-13T11:37:32.214 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.214 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::7c7b:8aff:fecd:e105/64 scope link 2024-06-13T11:37:32.214 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:32.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-13T11:37:32.280 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:32.280 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:32.280 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:32.280 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.280 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 7e:7b:8a:cd:e1:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::7c7b:8aff:fecd:e105/64 scope link 2024-06-13T11:37:32.281 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:32.282 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-06-13T11:37:32.282 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:32.282 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:32.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-06-13T11:37:32.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-13T11:37:32.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-06-13T11:37:32.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-06-13T11:37:32.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-06-13T11:37:32.283 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:32.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:32.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:32.438 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:32.438 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:37:32.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.1 up 2024-06-13T11:37:32.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.1 master ceph-brx 2024-06-13T11:37:32.439 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:37:32.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:32.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:32.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:32.521 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-06-13T11:37:32.536 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-06-13T11:37:32.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:32.536 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-06-13T11:37:32.591 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-06-13T11:37:32.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:32.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:32.675 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.53:3300,172.21.15.53:3301" 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 2@3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.cephfs=/ 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.43:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-06-13T11:37:32.683 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T11:37:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T11:37:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T11:37:32.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T11:37:32.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:32.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-06-13T11:37:32.710 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:32.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:32.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:32.808 INFO:teuthology.orchestra.run.smithi043.stdout:client4746 2024-06-13T11:37:32.808 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:32.808 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:32.824 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:32.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:32.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:32.923 INFO:teuthology.orchestra.run.smithi043.stdout:client4746 2024-06-13T11:37:32.923 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:32.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:32.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:32.980 INFO:teuthology.orchestra.run.smithi043.stdout:client4746 2024-06-13T11:37:32.981 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.client4746/status') 2024-06-13T11:37:33.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:33.041 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4746 (3)192.168.0.2:0/373904032 2024-06-13T11:37:33.041 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-06-13T11:37:33.041 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-06-13T11:37:33.041 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-06-13T11:37:33.041 INFO:teuthology.orchestra.run.smithi043.stderr:68 bytes copied, 2.42e-05 s, 2.8 MB/s 2024-06-13T11:37:33.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:33.048 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-06-13T11:37:33.049 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:37:33.049 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-13T11:37:33.049 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-13T11:37:33.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.153+0000 7fc7d1c72640 1 Processor -- start 2024-06-13T11:37:33.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.153+0000 7fc7d1c72640 1 -- start start 2024-06-13T11:37:33.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.153+0000 7fc7d1c72640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7cc1412d0 0x7fc7cc06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7d1c72640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7cc1416b0 con 0x7fc7cc06f090 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7d1c72640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7cc162cd0 con 0x7fc7cc162640 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7d1c72640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc7cc162a70 con 0x7fc7cc1412d0 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7caffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc7cc06f090 0x7fc7cc161f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60086/0 (socket says 172.21.15.43:60086) 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7caffd640 1 -- 172.21.15.43:0/1577029185 learned_addr learned my addr 172.21.15.43:0/1577029185 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7cb7fe640 1 --2- 172.21.15.43:0/1577029185 >> v2:172.21.15.53:3300/0 conn(0x7fc7cc1412d0 0x7fc7cc06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476962315 0 0) 0x7fc7cc1416b0 con 0x7fc7cc06f090 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7b4003520 con 0x7fc7cc06f090 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3917630163 0 0) 0x7fc7b4003520 con 0x7fc7cc06f090 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 >> v2:172.21.15.53:3300/0 conn(0x7fc7cc1412d0 msgr2=0x7fc7cc06eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 --2- 172.21.15.43:0/1577029185 >> v2:172.21.15.53:3300/0 conn(0x7fc7cc1412d0 0x7fc7cc06eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 >> v1:172.21.15.53:6789/0 conn(0x7fc7cc162640 legacy=0x7fc7cc0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc15ebe0 con 0x7fc7cc06f090 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fc7c0001670 con 0x7fc7cc06f090 2024-06-13T11:37:33.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7cb7fe640 1 --2- 172.21.15.43:0/1577029185 >> v2:172.21.15.53:3300/0 conn(0x7fc7cc1412d0 0x7fc7cc06eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 >> v1:172.21.15.43:6789/0 conn(0x7fc7cc06f090 legacy=0x7fc7cc161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40039b0 0x7fc7b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7b4004800 0x7fc7b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7b40051c0 0x7fc7b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc162a70 con 0x7fc7b40051c0 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b400c060 con 0x7fc7b40039b0 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.154+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b400c260 con 0x7fc7b4004800 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7b40051c0 0x7fc7b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cb7fe640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40039b0 0x7fc7b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7caffd640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7b4004800 0x7fc7b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 -- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7b4004800 msgr2=0x7fc7b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7b4004800 0x7fc7b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 -- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40039b0 msgr2=0x7fc7b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40039b0 0x7fc7b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 -- 172.21.15.43:0/1577029185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b4003520 con 0x7fc7b40051c0 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 -- 172.21.15.43:0/1577029185 reap_dead start 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.155+0000 7fc7cbfff640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7b40051c0 0x7fc7b400b9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001e50 tx=0x7fc7b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8373483ffd7844e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4001a70 con 0x7fc7b40051c0 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c4003970 con 0x7fc7b40051c0 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7ca7fc640 1 -- 172.21.15.43:0/1577029185 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4003d60 con 0x7fc7b40051c0 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 -- 172.21.15.43:0/1577029185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7b40051c0 msgr2=0x7fc7b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7b40051c0 0x7fc7b400b9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001e50 tx=0x7fc7b4005830 comp rx=0 tx=0).stop 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 -- 172.21.15.43:0/1577029185 shutdown_connections 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/1577029185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7b40051c0 0x7fc7b400b9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 -- 172.21.15.43:0/1577029185 >> 172.21.15.43:0/1577029185 conn(0x7fc7cc06e030 msgr2=0x7fc7cc06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:33.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 -- 172.21.15.43:0/1577029185 shutdown_connections 2024-06-13T11:37:33.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.156+0000 7fc7d1c72640 1 -- 172.21.15.43:0/1577029185 wait complete. 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.157+0000 7fc7d1c72640 1 Processor -- start 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 -- start start 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40051c0 0x7fc7cc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 0x7fc7cc13a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc1586f0 0x7fc7cc0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc15e890 con 0x7fc7cc158270 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc15f1a0 con 0x7fc7b40051c0 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7d1c72640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fc7cc15f6c0 con 0x7fc7cc1586f0 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7caffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 0x7fc7cc13a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7caffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 0x7fc7cc13a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50396/0 (socket says 172.21.15.43:50396) 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.158+0000 7fc7caffd640 1 -- 172.21.15.43:0/2178002211 learned_addr learned my addr 172.21.15.43:0/2178002211 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7cb7fe640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40051c0 0x7fc7cc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7cbfff640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc1586f0 0x7fc7cc0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7caffd640 1 -- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc1586f0 msgr2=0x7fc7cc0ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7caffd640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc1586f0 0x7fc7cc0ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7caffd640 1 -- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40051c0 msgr2=0x7fc7cc155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7caffd640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40051c0 0x7fc7cc155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7caffd640 1 -- 172.21.15.43:0/2178002211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc158b80 con 0x7fc7cc158270 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7cbfff640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc1586f0 0x7fc7cc0ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7caffd640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 0x7fc7cc13a9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00072f0 tx=0x7fc7c00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c001a070 con 0x7fc7cc158270 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c000f8e0 con 0x7fc7cc158270 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc0adb60 con 0x7fc7cc158270 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000fcb0 con 0x7fc7cc158270 2024-06-13T11:37:33.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.159+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc0ae400 con 0x7fc7cc158270 2024-06-13T11:37:33.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.160+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7cc04ffb0 con 0x7fc7cc158270 2024-06-13T11:37:33.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.160+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7c001d070 con 0x7fc7cc158270 2024-06-13T11:37:33.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.161+0000 7fc7b3fff640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7b806be30 0x7fc7b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:33.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.161+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc7c008aaa0 con 0x7fc7cc158270 2024-06-13T11:37:33.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.161+0000 7fc7cb7fe640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7b806be30 0x7fc7b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:33.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.162+0000 7fc7cb7fe640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7b806be30 0x7fc7b806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0093d0 tx=0x7fc7bc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:33.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.165+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7c0058b50 con 0x7fc7cc158270 2024-06-13T11:37:33.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.389+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7cc0d10f0 con 0x7fc7cc158270 2024-06-13T11:37:33.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.389+0000 7fc7b3fff640 1 -- 172.21.15.43:0/2178002211 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc7c005ce50 con 0x7fc7cc158270 2024-06-13T11:37:33.388 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:37:33.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7b806be30 msgr2=0x7fc7b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7b806be30 0x7fc7b806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0093d0 tx=0x7fc7bc009190 comp rx=0 tx=0).stop 2024-06-13T11:37:33.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 msgr2=0x7fc7cc13a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:33.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 0x7fc7cc13a9d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00072f0 tx=0x7fc7c00077b0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 shutdown_connections 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fc7b806be30 0x7fc7b806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fc7cc1586f0 0x7fc7cc0ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7cc158270 0x7fc7cc13a9d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 --2- 172.21.15.43:0/2178002211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b40051c0 0x7fc7cc155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 >> 172.21.15.43:0/2178002211 conn(0x7fc7cc06e030 msgr2=0x7fc7cc072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 shutdown_connections 2024-06-13T11:37:33.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:33.391+0000 7fc7d1c72640 1 -- 172.21.15.43:0/2178002211 wait complete. 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:37:33.401 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:37:33.402 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-06-13T11:37:33.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:33.402 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:33.422 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42694sec preferred_lft 42694sec 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link noprefixroute 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:33.423 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-06-13T11:37:33.423 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T11:37:33.423 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:33.424 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:33.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2024-06-13T11:37:33.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2024-06-13T11:37:33.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2024-06-13T11:37:33.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T11:37:33.424 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:33.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:33.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:33.645 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:37:33.672 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-06-13T11:37:33.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:33.674 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-06-13T11:37:33.744 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-06-13T11:37:33.744 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:37:33.744 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:37:33.744 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:37:33.744 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:37:33.745 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:33.745 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:33.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:37:33.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:37:33.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:37:33.745 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:33.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:34.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:34.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:34.034 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-06-13T11:37:34.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:34.050 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-06-13T11:37:34.105 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:34.105 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:34.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-13T11:37:34.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-06-13T11:37:34.106 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:34.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:34.227 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-06-13T11:37:34.227 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:34.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:34.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:34.361 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:34.361 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:34.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-06-13T11:37:34.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T11:37:34.361 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:34.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:34.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:34.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:34.441 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-06-13T11:37:34.456 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-06-13T11:37:34.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:34.456 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-06-13T11:37:34.511 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-06-13T11:37:34.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:34.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:34.615 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:34.615 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:34.738 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:34.738 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:34.738 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.53:3300,172.21.15.53:3301" 2024-06-13T11:37:34.738 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with new device syntax: 1@3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.cephfs=/ 2024-06-13T11:37:34.738 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.43:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2024-06-13T11:37:34.739 INFO:teuthology.orchestra.run.smithi053.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-06-13T11:37:34.740 INFO:teuthology.orchestra.run.smithi053.stdout: You just mounted a file system that supports labels which does not 2024-06-13T11:37:34.740 INFO:teuthology.orchestra.run.smithi053.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T11:37:34.740 INFO:teuthology.orchestra.run.smithi053.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T11:37:34.740 INFO:teuthology.orchestra.run.smithi053.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T11:37:34.741 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T11:37:34.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:34.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-06-13T11:37:34.767 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:34.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:34.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:34.864 INFO:teuthology.orchestra.run.smithi053.stdout:client4508 2024-06-13T11:37:34.865 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:34.865 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:34.881 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:34.979 INFO:teuthology.orchestra.run.smithi053.stdout:client4508 2024-06-13T11:37:34.980 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:35.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:35.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:35.123 INFO:teuthology.orchestra.run.smithi053.stdout:client4508 2024-06-13T11:37:35.123 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.client4508/status') 2024-06-13T11:37:35.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:35.184 INFO:teuthology.orchestra.run.smithi053.stdout:instance: client.4508 (3)192.168.0.1:0/1696172535 2024-06-13T11:37:35.184 INFO:teuthology.orchestra.run.smithi053.stdout:blocklisted: false 2024-06-13T11:37:35.184 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records in 2024-06-13T11:37:35.185 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records out 2024-06-13T11:37:35.185 INFO:teuthology.orchestra.run.smithi053.stderr:69 bytes copied, 2.7167e-05 s, 2.5 MB/s 2024-06-13T11:37:35.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:35.191 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-06-13T11:37:35.192 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:37:35.192 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-13T11:37:35.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-13T11:37:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.310+0000 7f0bff219640 1 Processor -- start 2024-06-13T11:37:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.310+0000 7f0bff219640 1 -- start start 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bff219640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf815f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bff219640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf8071d50 con 0x7f0bf80b78a0 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bff219640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf8162a00 con 0x7f0bf8162530 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bff219640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf815ef90 con 0x7f0bf80b6a70 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0bf80b78a0 0x7f0bf8161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60092/0 (socket says 172.21.15.43:60092) 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf7fff640 1 -- 172.21.15.43:0/1531349754 learned_addr learned my addr 172.21.15.43:0/1531349754 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051461748 0 0) 0x7f0bf8071d50 con 0x7f0bf80b78a0 2024-06-13T11:37:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be4003520 con 0x7f0bf80b78a0 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1258755806 0 0) 0x7f0be4003520 con 0x7f0bf80b78a0 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 msgr2=0x7f0bf815f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf815f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 >> v1:172.21.15.53:6789/0 conn(0x7f0bf8162530 legacy=0x7f0bf80b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf8162ce0 con 0x7f0bf80b78a0 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f0be0001670 con 0x7f0bf80b78a0 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 >> v1:172.21.15.43:6789/0 conn(0x7f0bf80b78a0 legacy=0x7f0bf8161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0be40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4003f20 0x7f0be4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be4004d40 0x7f0be40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf815ef90 con 0x7f0be4003f20 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0be400bad0 con 0x7f0be4004d40 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.311+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f0be400bcd0 con 0x7f0bf80b6a70 2024-06-13T11:37:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0be40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bf7fff640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4003f20 0x7f0be4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfd7b6640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be4004d40 0x7f0be40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfcfb5640 1 -- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be4004d40 msgr2=0x7f0be40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be4004d40 0x7f0be40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfcfb5640 1 -- 172.21.15.43:0/1531349754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4003f20 msgr2=0x7f0be4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4003f20 0x7f0be4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.312+0000 7f0bfcfb5640 1 -- 172.21.15.43:0/1531349754 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be4003520 con 0x7f0bf80b6a70 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0be40039e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009fc0 tx=0x7f0be4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55c7587bce15889 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8009c10 con 0x7f0bf80b6a70 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8036070 con 0x7f0bf80b6a70 2024-06-13T11:37:35.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bf77fe640 1 -- 172.21.15.43:0/1531349754 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be802d070 con 0x7f0bf80b6a70 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bff219640 1 -- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 msgr2=0x7f0be40039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bff219640 1 --2- 172.21.15.43:0/1531349754 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0be40039e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009fc0 tx=0x7f0be4005830 comp rx=0 tx=0).stop 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bfd7b6640 1 -- 172.21.15.43:0/1531349754 reap_dead start 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bff219640 1 -- 172.21.15.43:0/1531349754 shutdown_connections 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bff219640 1 -- 172.21.15.43:0/1531349754 >> 172.21.15.43:0/1531349754 conn(0x7f0bf806f110 msgr2=0x7f0bf806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bff219640 1 -- 172.21.15.43:0/1531349754 shutdown_connections 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.313+0000 7f0bff219640 1 -- 172.21.15.43:0/1531349754 wait complete. 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.315+0000 7f0bff219640 1 Processor -- start 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.315+0000 7f0bff219640 1 -- start start 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bff219640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf8159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bff219640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 0x7f0bf80cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bff219640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81f4ef0 0x7f0bf81f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bff219640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf80b6e50 con 0x7f0bf80cc440 2024-06-13T11:37:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bff219640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf815ec20 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bff219640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf815f420 con 0x7f0bf80b6a70 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bf7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 0x7f0bf80cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bf7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 0x7f0bf80cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50416/0 (socket says 172.21.15.43:50416) 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bf7fff640 1 -- 172.21.15.43:0/1569430312 learned_addr learned my addr 172.21.15.43:0/1569430312 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81f4ef0 0x7f0bf81f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf8159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 -- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 msgr2=0x7f0bf8159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf8159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 -- 172.21.15.43:0/1569430312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 msgr2=0x7f0bf80cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 0x7f0bf80cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 -- 172.21.15.43:0/1569430312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf81f4b80 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bf7fff640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 0x7f0bf80cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bfd7b6640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81f4ef0 0x7f0bf81f5370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0bf815e830 tx=0x7f0bf000fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0019070 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.316+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0005030 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.317+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf80cb960 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.317+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0005400 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.317+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf80b5b20 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.317+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf804ffb0 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.318+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bf0007030 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.318+0000 7f0bf57fa640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f0bd806be30 0x7f0bd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:35.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.319+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0bf008a380 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.319+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f0bd806be30 0x7f0bd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:35.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.319+0000 7f0bfcfb5640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f0bd806be30 0x7f0bd806e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0be8035000 tx=0x7f0be802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:35.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.323+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0bf0058280 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.547+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0bf80b7330 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.548+0000 7f0bf57fa640 1 -- 172.21.15.43:0/1569430312 <== mon.1 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f0bf005c580 con 0x7f0bf81f4ef0 2024-06-13T11:37:35.547 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:37:35.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f0bd806be30 msgr2=0x7f0bd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f0bd806be30 0x7f0bd806e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0be8035000 tx=0x7f0be802f000 comp rx=0 tx=0).stop 2024-06-13T11:37:35.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81f4ef0 msgr2=0x7f0bf81f5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:35.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81f4ef0 0x7f0bf81f5370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0bf815e830 tx=0x7f0bf000fc00 comp rx=0 tx=0).stop 2024-06-13T11:37:35.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 shutdown_connections 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f0bd806be30 0x7f0bd806e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81f4ef0 0x7f0bf81f5370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bf80cc440 0x7f0bf80cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 --2- 172.21.15.43:0/1569430312 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f0bf80b6a70 0x7f0bf8159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 >> 172.21.15.43:0/1569430312 conn(0x7f0bf806f110 msgr2=0x7f0bf80b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 shutdown_connections 2024-06-13T11:37:35.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:35.550+0000 7f0bff219640 1 -- 172.21.15.43:0/1569430312 wait complete. 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:37:35.560 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-06-13T11:37:35.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:35.560 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-06-13T11:37:35.577 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:35.577 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:37:35.578 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42692sec preferred_lft 42692sec 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link noprefixroute 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether aa:75:d8:1b:d1:e0 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::94cc:eaff:fe96:f96a/64 scope link 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:35.579 INFO:teuthology.orchestra.run.smithi053.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-13T11:37:35.580 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether aa:75:d8:1b:d1:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-13T11:37:35.580 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::a875:d8ff:fe1b:d1e0/64 scope link tentative 2024-06-13T11:37:35.580 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:35.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:35.580 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:37:35.643 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-06-13T11:37:35.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:35.645 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-06-13T11:37:35.702 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-06-13T11:37:35.702 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:37:35.702 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:37:35.702 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:37:35.703 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:37:35.703 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:35.703 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:35.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:37:35.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:37:35.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:37:35.703 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:35.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:35.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:35.833 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-06-13T11:37:35.849 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-13T11:37:35.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:35.850 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-06-13T11:37:35.906 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-06-13T11:37:35.906 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:35.906 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:35.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-13T11:37:35.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-06-13T11:37:35.906 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:35.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:36.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:36.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-13T11:37:36.051 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:36.051 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:36.051 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ee:f7:71:3a:58:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ecf7:71ff:fe3a:5891/64 scope link tentative 2024-06-13T11:37:36.052 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:36.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-13T11:37:36.119 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:37:36.119 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:37:36.119 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:37:36.119 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.119 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ee:f7:71:3a:58:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ecf7:71ff:fe3a:5891/64 scope link tentative 2024-06-13T11:37:36.120 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:37:36.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-06-13T11:37:36.121 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:36.121 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:36.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-06-13T11:37:36.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-13T11:37:36.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-06-13T11:37:36.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-06-13T11:37:36.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-06-13T11:37:36.122 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:36.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:36.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.277 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:37:36.277 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-06-13T11:37:36.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.1 up 2024-06-13T11:37:36.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.1 master ceph-brx 2024-06-13T11:37:36.278 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-06-13T11:37:36.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:36.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:36.356 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-06-13T11:37:36.386 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-06-13T11:37:36.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:37:36.386 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-06-13T11:37:36.441 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-06-13T11:37:36.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:36.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:36.525 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:36.525 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:36.533 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:37:36.533 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:37:36.533 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.53:3300,172.21.15.53:3301" 2024-06-13T11:37:36.533 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with new device syntax: 3@3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.cephfs=/ 2024-06-13T11:37:36.533 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.43:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2024-06-13T11:37:36.534 INFO:teuthology.orchestra.run.smithi053.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-06-13T11:37:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: You just mounted a file system that supports labels which does not 2024-06-13T11:37:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T11:37:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T11:37:36.534 INFO:teuthology.orchestra.run.smithi053.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T11:37:36.535 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T11:37:36.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:36.536 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-06-13T11:37:36.560 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:36.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.658 INFO:teuthology.orchestra.run.smithi053.stdout:client4761 2024-06-13T11:37:36.658 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:36.658 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:36.675 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:36.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:36.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.772 INFO:teuthology.orchestra.run.smithi053.stdout:client4761 2024-06-13T11:37:36.772 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:37:36.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:37:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.830 INFO:teuthology.orchestra.run.smithi053.stdout:client4761 2024-06-13T11:37:36.830 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.client4761/status') 2024-06-13T11:37:36.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:37:36.891 INFO:teuthology.orchestra.run.smithi053.stdout:instance: client.4761 (3)172.21.15.53:0/1314757036 2024-06-13T11:37:36.891 INFO:teuthology.orchestra.run.smithi053.stdout:blocklisted: false 2024-06-13T11:37:36.891 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records in 2024-06-13T11:37:36.891 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records out 2024-06-13T11:37:36.891 INFO:teuthology.orchestra.run.smithi053.stderr:70 bytes copied, 2.808e-05 s, 2.5 MB/s 2024-06-13T11:37:36.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-06-13T11:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:37:36.899 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-06-13T11:37:36.949 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-06-13T11:37:36.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:37.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.066+0000 7f2bedbf9640 1 Processor -- start 2024-06-13T11:37:37.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.067+0000 7f2bedbf9640 1 -- start start 2024-06-13T11:37:37.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.067+0000 7f2bedbf9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2be815c250 0x7f2be8071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.067+0000 7f2bedbf9640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be80b09f0 con 0x7f2be80cf580 2024-06-13T11:37:37.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.067+0000 7f2bedbf9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be8071dd0 con 0x7f2be8072b90 2024-06-13T11:37:37.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.067+0000 7f2bedbf9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2be8072700 con 0x7f2be815c250 2024-06-13T11:37:37.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2be80cf580 0x7f2be80a9490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60096/0 (socket says 172.21.15.43:60096) 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be7fff640 1 -- 172.21.15.43:0/2781993709 learned_addr learned my addr 172.21.15.43:0/2781993709 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be77fe640 1 --2- 172.21.15.43:0/2781993709 >> v2:172.21.15.53:3300/0 conn(0x7f2be815c250 0x7f2be8071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197601332 0 0) 0x7f2be80b09f0 con 0x7f2be80cf580 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bd0003520 con 0x7f2be80cf580 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983171302 0 0) 0x7f2be8071dd0 con 0x7f2be8072b90 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be80b09f0 con 0x7f2be8072b90 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be77fe640 1 -- 172.21.15.43:0/2781993709 >> v1:172.21.15.53:6789/0 conn(0x7f2be8072b90 legacy=0x7f2be80cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be77fe640 1 -- 172.21.15.43:0/2781993709 >> v1:172.21.15.43:6789/0 conn(0x7f2be80cf580 legacy=0x7f2be80a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2302604382 0 0) 0x7f2bd0003520 con 0x7f2be80cf580 2024-06-13T11:37:37.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.068+0000 7f2be77fe640 1 -- 172.21.15.43:0/2781993709 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be80720b0 con 0x7f2be815c250 2024-06-13T11:37:37.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.069+0000 7f2be77fe640 1 --2- 172.21.15.43:0/2781993709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be815c250 0x7f2be8071220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80097a0 tx=0x7f2bd802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=503c71811f8f2b30 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.069+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8037070 con 0x7f2be815c250 2024-06-13T11:37:37.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.069+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd802ac50 con 0x7f2be815c250 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.069+0000 7f2be67fc640 1 -- 172.21.15.43:0/2781993709 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be00019f0 con 0x7f2be815c250 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2781993709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be815c250 msgr2=0x7f2be8071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2781993709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be815c250 0x7f2be8071220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80097a0 tx=0x7f2bd802a1c0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2781993709 shutdown_connections 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2781993709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be815c250 0x7f2be8071220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2781993709 >> 172.21.15.43:0/2781993709 conn(0x7f2be80b14b0 msgr2=0x7f2be80b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2781993709 shutdown_connections 2024-06-13T11:37:37.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.070+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2781993709 wait complete. 2024-06-13T11:37:37.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.071+0000 7f2bedbf9640 1 Processor -- start 2024-06-13T11:37:37.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.071+0000 7f2bedbf9640 1 -- start start 2024-06-13T11:37:37.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2bedbf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be8072b90 0x7f2be8151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2bedbf9640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2be80cf580 0x7f2be8153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2bedbf9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 0x7f2be806cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2bedbf9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2be815c7b0 con 0x7f2be815c250 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2bedbf9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2be815c630 con 0x7f2be8072b90 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2bedbf9640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f2be80b0e30 con 0x7f2be80cf580 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2be7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 0x7f2be806cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2be7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 0x7f2be806cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50422/0 (socket says 172.21.15.43:50422) 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2be7fff640 1 -- 172.21.15.43:0/2743297173 learned_addr learned my addr 172.21.15.43:0/2743297173 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2be77fe640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be8072b90 0x7f2be8151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.072+0000 7f2be6ffd640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2be80cf580 0x7f2be8153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2be7fff640 1 -- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2be80cf580 msgr2=0x7f2be8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2be7fff640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2be80cf580 0x7f2be8153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2be7fff640 1 -- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be8072b90 msgr2=0x7f2be8151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2be7fff640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be8072b90 0x7f2be8151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2be7fff640 1 -- 172.21.15.43:0/2743297173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be8152ba0 con 0x7f2be815c250 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2be7fff640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 0x7f2be806cec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2be000cbe0 tx=0x7f2be000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0017070 con 0x7f2be815c250 2024-06-13T11:37:37.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be000ad40 con 0x7f2be815c250 2024-06-13T11:37:37.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be8152e80 con 0x7f2be815c250 2024-06-13T11:37:37.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0012600 con 0x7f2be815c250 2024-06-13T11:37:37.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.073+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be8153720 con 0x7f2be815c250 2024-06-13T11:37:37.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.074+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be8153050 con 0x7f2be815c250 2024-06-13T11:37:37.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.074+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2be001a070 con 0x7f2be815c250 2024-06-13T11:37:37.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.075+0000 7f2bcffff640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f2bd406be60 0x7f2bd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.075+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2be008b020 con 0x7f2be815c250 2024-06-13T11:37:37.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.075+0000 7f2be77fe640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f2bd406be60 0x7f2bd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.076+0000 7f2be77fe640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f2bd406be60 0x7f2bd406e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8034000 tx=0x7f2bd802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.079+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2be0058f30 con 0x7f2be815c250 2024-06-13T11:37:37.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.265+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2be8158130 con 0x7f2be815c250 2024-06-13T11:37:37.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.266+0000 7f2bcffff640 1 -- 172.21.15.43:0/2743297173 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f2be005d230 con 0x7f2be815c250 2024-06-13T11:37:37.265 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:37.266 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:37.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f2bd406be60 msgr2=0x7f2bd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f2bd406be60 0x7f2bd406e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8034000 tx=0x7f2bd802e000 comp rx=0 tx=0).stop 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 msgr2=0x7f2be806cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 0x7f2be806cec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2be000cbe0 tx=0x7f2be000a430 comp rx=0 tx=0).stop 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 shutdown_connections 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f2bd406be60 0x7f2bd406e320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2be815c250 0x7f2be806cec0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2be80cf580 0x7f2be8153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 --2- 172.21.15.43:0/2743297173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2be8072b90 0x7f2be8151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 >> 172.21.15.43:0/2743297173 conn(0x7f2be80b14b0 msgr2=0x7f2be815f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 shutdown_connections 2024-06-13T11:37:37.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.268+0000 7f2bedbf9640 1 -- 172.21.15.43:0/2743297173 wait complete. 2024-06-13T11:37:37.279 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-13T11:37:01.392960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-13T11:37:04.976802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-13T11:37:06.140645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-13T11:37:09.841737+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-13T11:37:37.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-13T11:37:37.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.387+0000 7f88eca8c640 1 Processor -- start 2024-06-13T11:37:37.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.387+0000 7f88eca8c640 1 -- start start 2024-06-13T11:37:37.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88eca8c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88eca8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88e80ce4b0 0x7f88e80d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88eca8c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e80c9290 con 0x7f88e8070850 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88eca8c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f88e80ce9e0 con 0x7f88e80ce4b0 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88eca8c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f88e80c7f90 con 0x7f88e8147240 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88e80ce4b0 0x7f88e80d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e659c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88e80ce4b0 0x7f88e80d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:45202/0 (socket says 172.21.15.43:45202) 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 -- 172.21.15.43:0/1880861988 learned_addr learned my addr 172.21.15.43:0/1880861988 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 -- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 msgr2=0x7f88e80c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 --2- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 -- 172.21.15.43:0/1880861988 >> v1:172.21.15.53:6789/0 conn(0x7f88e8070850 legacy=0x7f88e80ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.388+0000 7f88e5d9b640 1 -- 172.21.15.43:0/1880861988 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e80c8270 con 0x7f88e80ce4b0 2024-06-13T11:37:37.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.389+0000 7f88e5d9b640 1 --2- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e80d0900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009870 tx=0x7f88dc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7af982af3a2c709 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.389+0000 7f88e559a640 1 -- 172.21.15.43:0/1880861988 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc037070 con 0x7f88e80ce4b0 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.389+0000 7f88e559a640 1 -- 172.21.15.43:0/1880861988 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc032440 con 0x7f88e80ce4b0 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.389+0000 7f88e559a640 1 -- 172.21.15.43:0/1880861988 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc032810 con 0x7f88e80ce4b0 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 -- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 msgr2=0x7f88e80d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 --2- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e80d0900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009870 tx=0x7f88dc02a1c0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 -- 172.21.15.43:0/1880861988 shutdown_connections 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 --2- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e80d0900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 --2- 172.21.15.43:0/1880861988 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 -- 172.21.15.43:0/1880861988 >> 172.21.15.43:0/1880861988 conn(0x7f88e806bf10 msgr2=0x7f88e806c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 -- 172.21.15.43:0/1880861988 shutdown_connections 2024-06-13T11:37:37.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.390+0000 7f88eca8c640 1 -- 172.21.15.43:0/1880861988 wait complete. 2024-06-13T11:37:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.391+0000 7f88eca8c640 1 Processor -- start 2024-06-13T11:37:37.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.391+0000 7f88eca8c640 1 -- start start 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88eca8c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 0x7f88e813a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88eca8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e81406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88eca8c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88eca8c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88e80d0e40 con 0x7f88e8070850 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88eca8c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f88e80c8830 con 0x7f88e80ce4b0 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88eca8c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f88e8070d00 con 0x7f88e8147240 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88e659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 0x7f88e813a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88e659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 0x7f88e813a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50436/0 (socket says 172.21.15.43:50436) 2024-06-13T11:37:37.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88e659c640 1 -- 172.21.15.43:0/2438407934 learned_addr learned my addr 172.21.15.43:0/2438407934 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88e6d9d640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.392+0000 7f88e5d9b640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e81406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e659c640 1 -- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 msgr2=0x7f88e80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e659c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e659c640 1 -- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 msgr2=0x7f88e81406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e659c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e81406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e659c640 1 -- 172.21.15.43:0/2438407934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e813a840 con 0x7f88e8070850 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e6d9d640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e5d9b640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e81406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88e659c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 0x7f88e813a300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88d800e870 tx=0x7f88d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8017070 con 0x7f88e8070850 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d800c940 con 0x7f88e8070850 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e8161290 con 0x7f88e8070850 2024-06-13T11:37:37.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d800cd30 con 0x7f88e8070850 2024-06-13T11:37:37.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.393+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e813f930 con 0x7f88e8070850 2024-06-13T11:37:37.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.394+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e80688a0 con 0x7f88e8070850 2024-06-13T11:37:37.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.394+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88d801a070 con 0x7f88e8070850 2024-06-13T11:37:37.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.395+0000 7f88d6ffd640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.395+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88d808b0e0 con 0x7f88e8070850 2024-06-13T11:37:37.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.395+0000 7f88e5d9b640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.396+0000 7f88e5d9b640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034000 tx=0x7f88dc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.399+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f88d80596c0 con 0x7f88e8070850 2024-06-13T11:37:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.585+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88e8161dd0 con 0x7f88e8070850 2024-06-13T11:37:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.585+0000 7f88d6ffd640 1 -- 172.21.15.43:0/2438407934 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f88d8058fc0 con 0x7f88e8070850 2024-06-13T11:37:37.584 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-06-13T11:37:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f88c806be30 msgr2=0x7f88c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034000 tx=0x7f88dc02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 msgr2=0x7f88e813a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 0x7f88e813a300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88d800e870 tx=0x7f88d800ed30 comp rx=0 tx=0).stop 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 shutdown_connections 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88e8147240 0x7f88e80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e80ce4b0 0x7f88e81406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 --2- 172.21.15.43:0/2438407934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88e8070850 0x7f88e813a300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 >> 172.21.15.43:0/2438407934 conn(0x7f88e806bf10 msgr2=0x7f88e8142a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 shutdown_connections 2024-06-13T11:37:37.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.587+0000 7f88eca8c640 1 -- 172.21.15.43:0/2438407934 wait complete. 2024-06-13T11:37:37.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-13T11:37:37.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.705+0000 7f3c06445640 1 Processor -- start 2024-06-13T11:37:37.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.705+0000 7f3c06445640 1 -- start start 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c06445640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3c000d1d30 0x7f3c0015e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c06445640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3c000715d0 0x7f3c000cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c06445640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000cf2f0 0x7f3c00161f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c06445640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3c00072d70 con 0x7f3c000715d0 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c06445640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3c000b1440 con 0x7f3c000d1d30 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c06445640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3c00071a50 con 0x7f3c000cf2f0 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3bf7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3c000715d0 0x7f3c000cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3bf7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3c000715d0 0x7f3c000cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50450/0 (socket says 172.21.15.43:50450) 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3bf7fff640 1 -- 172.21.15.43:0/1501412296 learned_addr learned my addr 172.21.15.43:0/1501412296 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3bfffff640 1 --2- 172.21.15.43:0/1501412296 >> v2:172.21.15.53:3300/0 conn(0x7f3c000d1d30 0x7f3c0015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.706+0000 7f3c049e2640 1 --2- 172.21.15.43:0/1501412296 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000cf2f0 0x7f3c00161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.707+0000 7f3bf7fff640 1 -- 172.21.15.43:0/1501412296 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000cf2f0 msgr2=0x7f3c00161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:37.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.707+0000 7f3bf7fff640 1 --2- 172.21.15.43:0/1501412296 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000cf2f0 0x7f3c00161f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.707+0000 7f3bf7fff640 1 -- 172.21.15.43:0/1501412296 >> v2:172.21.15.53:3300/0 conn(0x7f3c000d1d30 msgr2=0x7f3c0015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:37.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.707+0000 7f3bf7fff640 1 --2- 172.21.15.43:0/1501412296 >> v2:172.21.15.53:3300/0 conn(0x7f3c000d1d30 0x7f3c0015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.707+0000 7f3bf7fff640 1 -- 172.21.15.43:0/1501412296 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c000d2110 con 0x7f3c000715d0 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.707+0000 7f3bf7fff640 1 --2- 172.21.15.43:0/1501412296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000715d0 0x7f3c000cedb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3c0006dc40 tx=0x7f3be802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65be5165ccac2872 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3bff7fe640 1 -- 172.21.15.43:0/1501412296 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8037070 con 0x7f3c000715d0 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3bff7fe640 1 -- 172.21.15.43:0/1501412296 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be8032440 con 0x7f3c000715d0 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3bff7fe640 1 -- 172.21.15.43:0/1501412296 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032810 con 0x7f3c000715d0 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 -- 172.21.15.43:0/1501412296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000715d0 msgr2=0x7f3c000cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 --2- 172.21.15.43:0/1501412296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000715d0 0x7f3c000cedb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3c0006dc40 tx=0x7f3be802a1e0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 -- 172.21.15.43:0/1501412296 shutdown_connections 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 --2- 172.21.15.43:0/1501412296 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000cf2f0 0x7f3c00161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 --2- 172.21.15.43:0/1501412296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000715d0 0x7f3c000cedb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 --2- 172.21.15.43:0/1501412296 >> v2:172.21.15.53:3300/0 conn(0x7f3c000d1d30 0x7f3c0015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 -- 172.21.15.43:0/1501412296 >> 172.21.15.43:0/1501412296 conn(0x7f3c0006cb10 msgr2=0x7f3c0006cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:37.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 -- 172.21.15.43:0/1501412296 shutdown_connections 2024-06-13T11:37:37.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.708+0000 7f3c06445640 1 -- 172.21.15.43:0/1501412296 wait complete. 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.709+0000 7f3c06445640 1 Processor -- start 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 -- start start 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c000715d0 0x7f3c001566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 0x7f3c001525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000d1d30 0x7f3c001504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00072290 con 0x7f3c000cf2f0 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00071fb0 con 0x7f3c000715d0 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3c06445640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3c00072570 con 0x7f3c000d1d30 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 0x7f3c001525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3bf7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 0x7f3c001525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50462/0 (socket says 172.21.15.43:50462) 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3bf7fff640 1 -- 172.21.15.43:0/333834828 learned_addr learned my addr 172.21.15.43:0/333834828 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.710+0000 7f3bfffff640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c000715d0 0x7f3c001566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3c049e2640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000d1d30 0x7f3c001504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bf7fff640 1 -- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000d1d30 msgr2=0x7f3c001504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bf7fff640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000d1d30 0x7f3c001504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bf7fff640 1 -- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c000715d0 msgr2=0x7f3c001566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bf7fff640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c000715d0 0x7f3c001566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bf7fff640 1 -- 172.21.15.43:0/333834828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c00155080 con 0x7f3c000cf2f0 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bf7fff640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 0x7f3c001525b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3be802a220 tx=0x7f3be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8041020 con 0x7f3c000cf2f0 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be803d620 con 0x7f3c000cf2f0 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c00154500 con 0x7f3c000cf2f0 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8037040 con 0x7f3c000cf2f0 2024-06-13T11:37:37.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.711+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c00154ac0 con 0x7f3c000cf2f0 2024-06-13T11:37:37.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.712+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0004ffb0 con 0x7f3c000cf2f0 2024-06-13T11:37:37.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.713+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3be8044020 con 0x7f3c000cf2f0 2024-06-13T11:37:37.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.713+0000 7f3bfd7fa640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:37.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.713+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3be80ab690 con 0x7f3c000cf2f0 2024-06-13T11:37:37.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.714+0000 7f3bfffff640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:37.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.714+0000 7f3bfffff640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3be006be30 0x7f3be006e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009ac0 tx=0x7f3bf0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:37.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.718+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3be804b030 con 0x7f3c000cf2f0 2024-06-13T11:37:37.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.901+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3c00150240 con 0x7f3c000cf2f0 2024-06-13T11:37:37.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.901+0000 7f3bfd7fa640 1 -- 172.21.15.43:0/333834828 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f3be8079740 con 0x7f3c000cf2f0 2024-06-13T11:37:37.900 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3be006be30 msgr2=0x7f3be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3be006be30 0x7f3be006e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009ac0 tx=0x7f3bf0009190 comp rx=0 tx=0).stop 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 msgr2=0x7f3c001525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 0x7f3c001525b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3be802a220 tx=0x7f3be80046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 shutdown_connections 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3c000d1d30 0x7f3c001504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c000cf2f0 0x7f3c001525b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 --2- 172.21.15.43:0/333834828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c000715d0 0x7f3c001566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 >> 172.21.15.43:0/333834828 conn(0x7f3c0006cb10 msgr2=0x7f3c000b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 shutdown_connections 2024-06-13T11:37:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:37.903+0000 7f3c06445640 1 -- 172.21.15.43:0/333834828 wait complete. 2024-06-13T11:37:37.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-13T11:37:38.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.021+0000 7fe74c03f640 1 Processor -- start 2024-06-13T11:37:38.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.021+0000 7fe74c03f640 1 -- start start 2024-06-13T11:37:38.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74c03f640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe74415bf00 0x7fe7440a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74c03f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe74415c2e0 0x7fe7440cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74c03f640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74415cc10 con 0x7fe74415c760 2024-06-13T11:37:38.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74c03f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe74415cef0 con 0x7fe74415c2e0 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74c03f640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe74415d1d0 con 0x7fe74415bf00 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74a5dc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe74415c760 0x7fe74415fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60104/0 (socket says 172.21.15.43:60104) 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.022+0000 7fe74a5dc640 1 -- 172.21.15.43:0/1392710900 learned_addr learned my addr 172.21.15.43:0/1392710900 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69476485 0 0) 0x7fe74415cc10 con 0x7fe74415c760 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe72c003520 con 0x7fe74415c760 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe7495da640 1 --2- 172.21.15.43:0/1392710900 >> v2:172.21.15.53:3300/0 conn(0x7fe74415c2e0 0x7fe7440cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe74415bf00 0x7fe7440a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3922311918 0 0) 0x7fe72c003520 con 0x7fe74415c760 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe74415bf00 msgr2=0x7fe7440a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe74415bf00 0x7fe7440a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 >> v2:172.21.15.53:3300/0 conn(0x7fe74415c2e0 msgr2=0x7fe7440cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 --2- 172.21.15.43:0/1392710900 >> v2:172.21.15.53:3300/0 conn(0x7fe74415c2e0 0x7fe7440cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74415d4b0 con 0x7fe74415c760 2024-06-13T11:37:38.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fe73c001670 con 0x7fe74415c760 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 >> v1:172.21.15.43:6789/0 conn(0x7fe74415c760 legacy=0x7fe74415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe72c0039b0 0x7fe72c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c004800 0x7fe72c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe72c0051c0 0x7fe72c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe74415cef0 con 0x7fe72c0039b0 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe74415d1d0 con 0x7fe72c004800 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe72c00c090 con 0x7fe72c0051c0 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe7495da640 1 --2- 172.21.15.43:0/1392710900 >> v2:172.21.15.53:3300/0 conn(0x7fe74415c2e0 0x7fe7440cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe74415bf00 0x7fe7440a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe72c0039b0 0x7fe72c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe74a5dc640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe72c0051c0 0x7fe72c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe7495da640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c004800 0x7fe72c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 -- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe72c0051c0 msgr2=0x7fe72c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe72c0051c0 0x7fe72c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 -- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c004800 msgr2=0x7fe72c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c004800 0x7fe72c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe749ddb640 1 -- 172.21.15.43:0/1392710900 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c003520 con 0x7fe72c0039b0 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.023+0000 7fe74a5dc640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe72c0051c0 0x7fe72c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.024+0000 7fe749ddb640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe72c0039b0 0x7fe72c003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe734009f00 tx=0x7fe72c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1616cbca0d5c82 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.024+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734009b50 con 0x7fe72c0039b0 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.024+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe734003990 con 0x7fe72c0039b0 2024-06-13T11:37:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.024+0000 7fe748dd9640 1 -- 172.21.15.43:0/1392710900 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734003d60 con 0x7fe72c0039b0 2024-06-13T11:37:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74c03f640 1 -- 172.21.15.43:0/1392710900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe72c0039b0 msgr2=0x7fe72c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74c03f640 1 --2- 172.21.15.43:0/1392710900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe72c0039b0 0x7fe72c003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe734009f00 tx=0x7fe72c005830 comp rx=0 tx=0).stop 2024-06-13T11:37:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74a5dc640 1 -- 172.21.15.43:0/1392710900 reap_dead start 2024-06-13T11:37:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74c03f640 1 -- 172.21.15.43:0/1392710900 shutdown_connections 2024-06-13T11:37:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74c03f640 1 -- 172.21.15.43:0/1392710900 >> 172.21.15.43:0/1392710900 conn(0x7fe7440b14b0 msgr2=0x7fe7440b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74c03f640 1 -- 172.21.15.43:0/1392710900 shutdown_connections 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.025+0000 7fe74c03f640 1 -- 172.21.15.43:0/1392710900 wait complete. 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.026+0000 7fe74c03f640 1 Processor -- start 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.026+0000 7fe74c03f640 1 -- start start 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74c03f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c0039b0 0x7fe744143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74c03f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 0x7fe7440cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74c03f640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe744152f50 0x7fe7440ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74c03f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7440cf3b0 con 0x7fe744152af0 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74c03f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe744071f20 con 0x7fe72c0039b0 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74c03f640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe7440cf530 con 0x7fe744152f50 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 0x7fe7440cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 0x7fe7440cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50478/0 (socket says 172.21.15.43:50478) 2024-06-13T11:37:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 -- 172.21.15.43:0/2211473178 learned_addr learned my addr 172.21.15.43:0/2211473178 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe74a5dc640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe744152f50 0x7fe7440ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe749ddb640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c0039b0 0x7fe744143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 -- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe744152f50 msgr2=0x7fe7440ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe744152f50 0x7fe7440ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 -- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c0039b0 msgr2=0x7fe744143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c0039b0 0x7fe744143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.027+0000 7fe7495da640 1 -- 172.21.15.43:0/2211473178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe744143fc0 con 0x7fe744152af0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.028+0000 7fe7495da640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 0x7fe7440cdc70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7380107e0 tx=0x7fe738010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.028+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73801a020 con 0x7fe744152af0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.028+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73800eb60 con 0x7fe744152af0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.028+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe744155a20 con 0x7fe744152af0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.028+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73800f040 con 0x7fe744152af0 2024-06-13T11:37:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.028+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe744150e30 con 0x7fe744152af0 2024-06-13T11:37:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.029+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7440688c0 con 0x7fe744152af0 2024-06-13T11:37:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.029+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe73801d020 con 0x7fe744152af0 2024-06-13T11:37:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.030+0000 7fe7427fc640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe73006be30 0x7fe73006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.030+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe73808bb10 con 0x7fe744152af0 2024-06-13T11:37:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.030+0000 7fe749ddb640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe73006be30 0x7fe73006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.031+0000 7fe749ddb640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe73006be30 0x7fe73006e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe734009f00 tx=0x7fe73400d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.034+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe738024020 con 0x7fe744152af0 2024-06-13T11:37:38.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.216+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe74404ffb0 con 0x7fe744152af0 2024-06-13T11:37:38.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.217+0000 7fe7427fc640 1 -- 172.21.15.43:0/2211473178 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fe744143fc0 con 0x7fe744152af0 2024-06-13T11:37:38.216 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-06-13T11:37:38.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe73006be30 msgr2=0x7fe73006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe73006be30 0x7fe73006e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe734009f00 tx=0x7fe73400d040 comp rx=0 tx=0).stop 2024-06-13T11:37:38.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 msgr2=0x7fe7440cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 0x7fe7440cdc70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7380107e0 tx=0x7fe738010ca0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 shutdown_connections 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe73006be30 0x7fe73006e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe744152f50 0x7fe7440ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe744152af0 0x7fe7440cdc70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 --2- 172.21.15.43:0/2211473178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe72c0039b0 0x7fe744143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 >> 172.21.15.43:0/2211473178 conn(0x7fe7440b14b0 msgr2=0x7fe7440b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 shutdown_connections 2024-06-13T11:37:38.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.219+0000 7fe74c03f640 1 -- 172.21.15.43:0/2211473178 wait complete. 2024-06-13T11:37:38.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-13T11:37:38.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.336+0000 7ffbdb141640 1 Processor -- start 2024-06-13T11:37:38.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.337+0000 7ffbdb141640 1 -- start start 2024-06-13T11:37:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.337+0000 7ffbdb141640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbd40aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.337+0000 7ffbdb141640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbd40d1cd0 0x7ffbd40ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.337+0000 7ffbdb141640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd40d3630 con 0x7ffbd40ae200 2024-06-13T11:37:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.337+0000 7ffbdb141640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd40d3910 con 0x7ffbd40d1cd0 2024-06-13T11:37:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.337+0000 7ffbdb141640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd40d3bf0 con 0x7ffbd415e460 2024-06-13T11:37:38.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd3fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffbd40ae200 0x7ffbd40d15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60114/0 (socket says 172.21.15.43:60114) 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd3fff640 1 -- 172.21.15.43:0/129748362 learned_addr learned my addr 172.21.15.43:0/129748362 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd96de640 1 --2- 172.21.15.43:0/129748362 >> v2:172.21.15.53:3300/0 conn(0x7ffbd40d1cd0 0x7ffbd40ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd8edd640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbd40aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2657452898 0 0) 0x7ffbd40d3630 con 0x7ffbd40ae200 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbbc003520 con 0x7ffbd40ae200 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3369421546 0 0) 0x7ffbbc003520 con 0x7ffbd40ae200 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 msgr2=0x7ffbd40aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbd40aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 >> v2:172.21.15.53:3300/0 conn(0x7ffbd40d1cd0 msgr2=0x7ffbd40ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 --2- 172.21.15.43:0/129748362 >> v2:172.21.15.53:3300/0 conn(0x7ffbd40d1cd0 0x7ffbd40ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd40d3ed0 con 0x7ffbd40ae200 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7ffbc8001670 con 0x7ffbd40ae200 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 >> v1:172.21.15.43:6789/0 conn(0x7ffbd40ae200 legacy=0x7ffbd40d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbbc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbbc004d40 0x7ffbbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd40d3910 con 0x7ffbbc003f30 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd40d3bf0 con 0x7ffbbc004d40 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffbbc00ba10 con 0x7ffbd415e460 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd96de640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbbc004d40 0x7ffbbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.338+0000 7ffbd8edd640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbbc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd3fff640 1 -- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 msgr2=0x7ffbbc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbbc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd3fff640 1 -- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbbc004d40 msgr2=0x7ffbbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbbc004d40 0x7ffbbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd3fff640 1 -- 172.21.15.43:0/129748362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbbc003520 con 0x7ffbbc003f30 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd8edd640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd415e460 0x7ffbbc0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd96de640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbbc004d40 0x7ffbbc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbbc004800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c270 tx=0x7ffbbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bbf71d55ccf5d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8007d30 con 0x7ffbbc003f30 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc8005ad0 con 0x7ffbbc003f30 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.339+0000 7ffbd37fe640 1 -- 172.21.15.43:0/129748362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8007070 con 0x7ffbbc003f30 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbdb141640 1 -- 172.21.15.43:0/129748362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 msgr2=0x7ffbbc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbdb141640 1 --2- 172.21.15.43:0/129748362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbbc004800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c270 tx=0x7ffbbc005830 comp rx=0 tx=0).stop 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbd96de640 1 -- 172.21.15.43:0/129748362 reap_dead start 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbdb141640 1 -- 172.21.15.43:0/129748362 shutdown_connections 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbdb141640 1 -- 172.21.15.43:0/129748362 >> 172.21.15.43:0/129748362 conn(0x7ffbd40673d0 msgr2=0x7ffbd40d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbdb141640 1 -- 172.21.15.43:0/129748362 shutdown_connections 2024-06-13T11:37:38.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.340+0000 7ffbdb141640 1 -- 172.21.15.43:0/129748362 wait complete. 2024-06-13T11:37:38.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.341+0000 7ffbdb141640 1 Processor -- start 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.341+0000 7ffbdb141640 1 -- start start 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbdb141640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbd4139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbdb141640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbd41530c0 0x7ffbd4155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbdb141640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd4156400 0x7ffbd415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbdb141640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd40b0100 con 0x7ffbbc003f30 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbdb141640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd40aff80 con 0x7ffbd41530c0 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbdb141640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd40b0280 con 0x7ffbd4156400 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbd8edd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbd4139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbd8edd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbd4139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50496/0 (socket says 172.21.15.43:50496) 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbd8edd640 1 -- 172.21.15.43:0/252721216 learned_addr learned my addr 172.21.15.43:0/252721216 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbd96de640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd4156400 0x7ffbd415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.342+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbd41530c0 0x7ffbd4155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd8edd640 1 -- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd4156400 msgr2=0x7ffbd415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd8edd640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd4156400 0x7ffbd415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd8edd640 1 -- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbd41530c0 msgr2=0x7ffbd4155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd8edd640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbd41530c0 0x7ffbd4155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd8edd640 1 -- 172.21.15.43:0/252721216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd4142ff0 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd8edd640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbd4139a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4011730 tx=0x7ffbc4011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400f9c0 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc400fb60 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4015460 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd4153660 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.343+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd4151af0 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.344+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd404ffb0 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.345+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbc4015600 con 0x7ffbbc003f30 2024-06-13T11:37:38.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.345+0000 7ffbd17fa640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffbc006be30 0x7ffbc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.345+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffbc408bb20 con 0x7ffbbc003f30 2024-06-13T11:37:38.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.345+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffbc006be30 0x7ffbc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.346+0000 7ffbd3fff640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffbc006be30 0x7ffbc006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8033000 tx=0x7ffbc8009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.349+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffbc4019030 con 0x7ffbbc003f30 2024-06-13T11:37:38.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.533+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ffbd40ab700 con 0x7ffbbc003f30 2024-06-13T11:37:38.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.534+0000 7ffbd17fa640 1 -- 172.21.15.43:0/252721216 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7ffbc405a190 con 0x7ffbbc003f30 2024-06-13T11:37:38.533 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffbc006be30 msgr2=0x7ffbc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffbc006be30 0x7ffbc006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8033000 tx=0x7ffbc8009030 comp rx=0 tx=0).stop 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 msgr2=0x7ffbd4139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbd4139a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4011730 tx=0x7ffbc4011bf0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 shutdown_connections 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ffbc006be30 0x7ffbc006e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ffbd4156400 0x7ffbd415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbd41530c0 0x7ffbd4155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 --2- 172.21.15.43:0/252721216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbbc003f30 0x7ffbd4139a50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 >> 172.21.15.43:0/252721216 conn(0x7ffbd40673d0 msgr2=0x7ffbd40b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:38.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 shutdown_connections 2024-06-13T11:37:38.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.536+0000 7ffbdb141640 1 -- 172.21.15.43:0/252721216 wait complete. 2024-06-13T11:37:38.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-06-13T11:37:38.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.650+0000 7f8a56238640 1 Processor -- start 2024-06-13T11:37:38.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.650+0000 7f8a56238640 1 -- start start 2024-06-13T11:37:38.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a56238640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a50155420 0x7f8a500ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a56238640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a500ae9c0 0x7f8a500d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a56238640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a500aa5d0 con 0x7f8a500d2fd0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a56238640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8a50155800 con 0x7f8a500ae9c0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a56238640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500ace10 con 0x7f8a50155420 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a4ffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8a500d2fd0 0x7f8a50161ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60126/0 (socket says 172.21.15.43:60126) 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.651+0000 7f8a4ffff640 1 -- 172.21.15.43:0/2889024139 learned_addr learned my addr 172.21.15.43:0/2889024139 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4effd640 1 --2- 172.21.15.43:0/2889024139 >> v2:172.21.15.53:3300/0 conn(0x7f8a500ae9c0 0x7f8a500d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a50155420 0x7f8a500ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139435830 0 0) 0x7f8a500aa5d0 con 0x7f8a500d2fd0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a38003520 con 0x7f8a500d2fd0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 172904030 0 0) 0x7f8a38003520 con 0x7f8a500d2fd0 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a50155420 msgr2=0x7f8a500ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a50155420 0x7f8a500ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 >> v2:172.21.15.53:3300/0 conn(0x7f8a500ae9c0 msgr2=0x7f8a500d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 --2- 172.21.15.43:0/2889024139 >> v2:172.21.15.53:3300/0 conn(0x7f8a500ae9c0 0x7f8a500d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a500aa870 con 0x7f8a500d2fd0 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f8a48001670 con 0x7f8a500d2fd0 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4effd640 1 --2- 172.21.15.43:0/2889024139 >> v2:172.21.15.53:3300/0 conn(0x7f8a500ae9c0 0x7f8a500d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 >> v1:172.21.15.43:6789/0 conn(0x7f8a500d2fd0 legacy=0x7f8a50161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a380039b0 0x7f8a38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a38004800 0x7f8a38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380051c0 0x7f8a3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a50155800 con 0x7f8a380039b0 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500ace10 con 0x7f8a380051c0 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3800bf00 con 0x7f8a38004800 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a50155420 0x7f8a500ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a380039b0 0x7f8a38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4ffff640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380051c0 0x7f8a3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.652+0000 7f8a4effd640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a38004800 0x7f8a38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4f7fe640 1 -- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a38004800 msgr2=0x7f8a38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a38004800 0x7f8a38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4f7fe640 1 -- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380051c0 msgr2=0x7f8a3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380051c0 0x7f8a3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4f7fe640 1 -- 172.21.15.43:0/2889024139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38003520 con 0x7f8a380039b0 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4effd640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a38004800 0x7f8a38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a380039b0 0x7f8a38003dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000e1f0 tx=0x7f8a38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b0f35391aacb02 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.653+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40009d40 con 0x7f8a380039b0 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a40035070 con 0x7f8a380039b0 2024-06-13T11:37:38.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a4e7fc640 1 -- 172.21.15.43:0/2889024139 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40004030 con 0x7f8a380039b0 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a56238640 1 -- 172.21.15.43:0/2889024139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a380039b0 msgr2=0x7f8a38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a56238640 1 --2- 172.21.15.43:0/2889024139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a380039b0 0x7f8a38003dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000e1f0 tx=0x7f8a38005830 comp rx=0 tx=0).stop 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a4ffff640 1 -- 172.21.15.43:0/2889024139 reap_dead start 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a56238640 1 -- 172.21.15.43:0/2889024139 shutdown_connections 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a56238640 1 -- 172.21.15.43:0/2889024139 >> 172.21.15.43:0/2889024139 conn(0x7f8a50067640 msgr2=0x7f8a500d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a56238640 1 -- 172.21.15.43:0/2889024139 shutdown_connections 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.654+0000 7f8a56238640 1 -- 172.21.15.43:0/2889024139 wait complete. 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.655+0000 7f8a56238640 1 Processor -- start 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 -- start start 2024-06-13T11:37:38.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380039b0 0x7f8a500b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 0x7f8a50158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a501594e0 0x7f8a5015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500ab110 con 0x7f8a500b11b0 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500aae30 con 0x7f8a380039b0 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a56238640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500ab630 con 0x7f8a501594e0 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 0x7f8a50158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 0x7f8a50158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50516/0 (socket says 172.21.15.43:50516) 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.656+0000 7f8a4effd640 1 -- 172.21.15.43:0/667995391 learned_addr learned my addr 172.21.15.43:0/667995391 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4ffff640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a501594e0 0x7f8a5015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380039b0 0x7f8a500b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4effd640 1 -- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a501594e0 msgr2=0x7f8a5015b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4effd640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a501594e0 0x7f8a5015b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4effd640 1 -- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380039b0 msgr2=0x7f8a500b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4effd640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380039b0 0x7f8a500b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:38.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4effd640 1 -- 172.21.15.43:0/667995391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a500b1720 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4ffff640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a501594e0 0x7f8a5015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a4effd640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 0x7f8a50158fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a44011930 tx=0x7f8a44011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400fb70 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4400fd10 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44015680 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a500b1a00 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.657+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a500b1fc0 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.658+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5004ffb0 con 0x7f8a500b11b0 2024-06-13T11:37:38.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.659+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a44015820 con 0x7f8a500b11b0 2024-06-13T11:37:38.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.659+0000 7f8a37fff640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:38.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.659+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a4408bb50 con 0x7f8a500b11b0 2024-06-13T11:37:38.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.659+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:38.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.660+0000 7f8a4f7fe640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a40034000 tx=0x7f8a4002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:38.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.664+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a44019030 con 0x7f8a500b11b0 2024-06-13T11:37:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:38.920+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f8a501598c0 con 0x7f8a500b11b0 2024-06-13T11:37:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.897+0000 7f8a37fff640 1 -- 172.21.15.43:0/667995391 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v48) ==== 147+0+0 (secure 0 0 0) 0x7f8a4405a1c0 con 0x7f8a500b11b0 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a3c06be30 msgr2=0x7f8a3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a40034000 tx=0x7f8a4002f000 comp rx=0 tx=0).stop 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 msgr2=0x7f8a50158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 0x7f8a50158fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a44011930 tx=0x7f8a44011df0 comp rx=0 tx=0).stop 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 shutdown_connections 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8a3c06be30 0x7f8a3c06e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8a501594e0 0x7f8a5015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a500b11b0 0x7f8a50158fa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 --2- 172.21.15.43:0/667995391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a380039b0 0x7f8a500b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.900+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 >> 172.21.15.43:0/667995391 conn(0x7f8a50067640 msgr2=0x7f8a50160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.901+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 shutdown_connections 2024-06-13T11:37:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:39.901+0000 7f8a56238640 1 -- 172.21.15.43:0/667995391 wait complete. 2024-06-13T11:37:39.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-13T11:37:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.028+0000 7f5c870a7640 1 Processor -- start 2024-06-13T11:37:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.028+0000 7f5c870a7640 1 -- start start 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c870a7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c80071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c870a7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c800ada40 con 0x7f5c801625b0 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c870a7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c800add20 con 0x7f5c800723e0 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c870a7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5c80072850 con 0x7f5c80162990 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c84e43640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5c801625b0 0x7f5c8015f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60136/0 (socket says 172.21.15.43:60136) 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c84e43640 1 -- 172.21.15.43:0/724119040 learned_addr learned my addr 172.21.15.43:0/724119040 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c77fff640 1 --2- 172.21.15.43:0/724119040 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c80071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130952517 0 0) 0x7f5c800ada40 con 0x7f5c801625b0 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c68003520 con 0x7f5c801625b0 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834685955 0 0) 0x7f5c800add20 con 0x7f5c800723e0 2024-06-13T11:37:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.029+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c800ada40 con 0x7f5c800723e0 2024-06-13T11:37:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.030+0000 7f5c77fff640 1 -- 172.21.15.43:0/724119040 >> v1:172.21.15.53:6789/0 conn(0x7f5c800723e0 legacy=0x7f5c8006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.030+0000 7f5c77fff640 1 -- 172.21.15.43:0/724119040 >> v1:172.21.15.43:6789/0 conn(0x7f5c801625b0 legacy=0x7f5c8015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.030+0000 7f5c77fff640 1 -- 172.21.15.43:0/724119040 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c800ae000 con 0x7f5c80162990 2024-06-13T11:37:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.030+0000 7f5c77fff640 1 --2- 172.21.15.43:0/724119040 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c80071ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c700097d0 tx=0x7f5c7002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6f3b8b619fea4f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70037070 con 0x7f5c80162990 2024-06-13T11:37:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c70032440 con 0x7f5c80162990 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c777fe640 1 -- 172.21.15.43:0/724119040 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700327f0 con 0x7f5c80162990 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 -- 172.21.15.43:0/724119040 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 msgr2=0x7f5c80071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 --2- 172.21.15.43:0/724119040 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c80071ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c700097d0 tx=0x7f5c7002a210 comp rx=0 tx=0).stop 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 -- 172.21.15.43:0/724119040 shutdown_connections 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 --2- 172.21.15.43:0/724119040 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c80071ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 -- 172.21.15.43:0/724119040 >> 172.21.15.43:0/724119040 conn(0x7f5c80070810 msgr2=0x7f5c80070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 -- 172.21.15.43:0/724119040 shutdown_connections 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.031+0000 7f5c870a7640 1 -- 172.21.15.43:0/724119040 wait complete. 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.032+0000 7f5c870a7640 1 Processor -- start 2024-06-13T11:37:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.032+0000 7f5c870a7640 1 -- start start 2024-06-13T11:37:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c870a7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 0x7f5c80157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c870a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c801625b0 0x7f5c800b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c870a7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c8015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c870a7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8006e220 con 0x7f5c800723e0 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c870a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5c800ae5c0 con 0x7f5c801625b0 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c870a7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8006e3a0 con 0x7f5c80162990 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c84e43640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 0x7f5c80157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c84e43640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 0x7f5c80157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50520/0 (socket says 172.21.15.43:50520) 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.033+0000 7f5c84e43640 1 -- 172.21.15.43:0/1229172353 learned_addr learned my addr 172.21.15.43:0/1229172353 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c77fff640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c801625b0 0x7f5c800b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c85644640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c8015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c84e43640 1 -- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 msgr2=0x7f5c8015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c84e43640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c8015e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c84e43640 1 -- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c801625b0 msgr2=0x7f5c800b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c84e43640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c801625b0 0x7f5c800b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c84e43640 1 -- 172.21.15.43:0/1229172353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c800b23c0 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c77fff640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c801625b0 0x7f5c800b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c84e43640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 0x7f5c80157160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00c4d0 tx=0x7f5c7c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c017070 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7c005ce0 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c801597b0 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c007270 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.034+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c80159d70 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.035+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c8004ffb0 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.036+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c7c01a070 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.036+0000 7f5c757fa640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5c6c06be60 0x7f5c6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.036+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5c7c08a4a0 con 0x7f5c800723e0 2024-06-13T11:37:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.036+0000 7f5c77fff640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5c6c06be60 0x7f5c6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.037+0000 7f5c77fff640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5c6c06be60 0x7f5c6c06e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c70034000 tx=0x7f5c7002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.040+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5c7c0584c0 con 0x7f5c800723e0 2024-06-13T11:37:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.226+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5c800b4ac0 con 0x7f5c800723e0 2024-06-13T11:37:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.230+0000 7f5c757fa640 1 -- 172.21.15.43:0/1229172353 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f5c7c05c7c0 con 0x7f5c800723e0 2024-06-13T11:37:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.231+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5c6c06be60 msgr2=0x7f5c6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.231+0000 7f5c870a7640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5c6c06be60 0x7f5c6c06e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c70034000 tx=0x7f5c7002e000 comp rx=0 tx=0).stop 2024-06-13T11:37:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 msgr2=0x7f5c80157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 0x7f5c80157160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00c4d0 tx=0x7f5c7c00c990 comp rx=0 tx=0).stop 2024-06-13T11:37:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 shutdown_connections 2024-06-13T11:37:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5c6c06be60 0x7f5c6c06e320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5c80162990 0x7f5c8015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c801625b0 0x7f5c800b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 --2- 172.21.15.43:0/1229172353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c800723e0 0x7f5c80157160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 >> 172.21.15.43:0/1229172353 conn(0x7f5c80070810 msgr2=0x7f5c8015c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 shutdown_connections 2024-06-13T11:37:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.232+0000 7f5c870a7640 1 -- 172.21.15.43:0/1229172353 wait complete. 2024-06-13T11:37:40.242 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-13T11:37:40.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-13T11:37:40.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-13T11:37:40.326 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-13T11:37:40.327 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:40.327 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:40.343 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:40.343 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:40.399 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:40.399 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:40.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T11:37:40.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.600+0000 7ff946fc1640 1 Processor -- start 2024-06-13T11:37:40.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.600+0000 7ff946fc1640 1 -- start start 2024-06-13T11:37:40.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff946fc1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9401412d0 0x7ff94006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff946fc1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff940162640 0x7ff9400b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff946fc1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9401416b0 con 0x7ff94006f090 2024-06-13T11:37:40.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff946fc1640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff940162a70 con 0x7ff940162640 2024-06-13T11:37:40.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff946fc1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff940162cd0 con 0x7ff9401412d0 2024-06-13T11:37:40.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff94555e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff940162640 0x7ff9400b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff94555e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff940162640 0x7ff9400b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50536/0 (socket says 172.21.15.43:50536) 2024-06-13T11:37:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.601+0000 7ff94555e640 1 -- 172.21.15.43:0/1419505808 learned_addr learned my addr 172.21.15.43:0/1419505808 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.602+0000 7ff94555e640 1 -- 172.21.15.43:0/1419505808 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9401412d0 msgr2=0x7ff94006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.602+0000 7ff94555e640 1 --2- 172.21.15.43:0/1419505808 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9401412d0 0x7ff94006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.602+0000 7ff94555e640 1 -- 172.21.15.43:0/1419505808 >> v1:172.21.15.53:6789/0 conn(0x7ff94006f090 legacy=0x7ff940161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:40.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.602+0000 7ff94555e640 1 -- 172.21.15.43:0/1419505808 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94015ebe0 con 0x7ff940162640 2024-06-13T11:37:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.602+0000 7ff94555e640 1 --2- 172.21.15.43:0/1419505808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff940162640 0x7ff9400b0ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff938009e50 tx=0x7ff93802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3383637a1fe2e767 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff93f7fe640 1 -- 172.21.15.43:0/1419505808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938036070 con 0x7ff940162640 2024-06-13T11:37:40.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff93f7fe640 1 -- 172.21.15.43:0/1419505808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff938031600 con 0x7ff940162640 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff93f7fe640 1 -- 172.21.15.43:0/1419505808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9380319d0 con 0x7ff940162640 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 -- 172.21.15.43:0/1419505808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff940162640 msgr2=0x7ff9400b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1419505808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff940162640 0x7ff9400b0ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff938009e50 tx=0x7ff93802a6c0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 -- 172.21.15.43:0/1419505808 shutdown_connections 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1419505808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff940162640 0x7ff9400b0ae0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1419505808 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9401412d0 0x7ff94006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 -- 172.21.15.43:0/1419505808 >> 172.21.15.43:0/1419505808 conn(0x7ff94006e030 msgr2=0x7ff94006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 -- 172.21.15.43:0/1419505808 shutdown_connections 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.603+0000 7ff946fc1640 1 -- 172.21.15.43:0/1419505808 wait complete. 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.604+0000 7ff946fc1640 1 Processor -- start 2024-06-13T11:37:40.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.604+0000 7ff946fc1640 1 -- start start 2024-06-13T11:37:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff946fc1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff94006f090 0x7ff94013ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff946fc1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 0x7ff940155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff946fc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff940162640 0x7ff94013c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff946fc1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff94015e890 con 0x7ff9401412d0 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff946fc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff94015f1a0 con 0x7ff940162640 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff946fc1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff94015f6c0 con 0x7ff94006f090 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 0x7ff940155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 0x7ff940155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50542/0 (socket says 172.21.15.43:50542) 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.605+0000 7ff93ffff640 1 -- 172.21.15.43:0/1789039560 learned_addr learned my addr 172.21.15.43:0/1789039560 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff944d5d640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff94006f090 0x7ff94013ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff94555e640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff940162640 0x7ff94013c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93ffff640 1 -- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff94006f090 msgr2=0x7ff94013ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93ffff640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff94006f090 0x7ff94013ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93ffff640 1 -- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff940162640 msgr2=0x7ff94013c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93ffff640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff940162640 0x7ff94013c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93ffff640 1 -- 172.21.15.43:0/1789039560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff940156670 con 0x7ff9401412d0 2024-06-13T11:37:40.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff94555e640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff940162640 0x7ff94013c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93ffff640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 0x7ff940155bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b3f0 tx=0x7ff93400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934015020 con 0x7ff9401412d0 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934011830 con 0x7ff9401412d0 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff940156950 con 0x7ff9401412d0 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934011c20 con 0x7ff9401412d0 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.606+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff940156f10 con 0x7ff9401412d0 2024-06-13T11:37:40.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.607+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94004ffb0 con 0x7ff9401412d0 2024-06-13T11:37:40.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.608+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff934018020 con 0x7ff9401412d0 2024-06-13T11:37:40.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.608+0000 7ff93d7fa640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:40.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.608+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff93408b090 con 0x7ff9401412d0 2024-06-13T11:37:40.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.609+0000 7ff944d5d640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:40.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.609+0000 7ff944d5d640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff92c06be30 0x7ff92c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff930009890 tx=0x7ff930008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:40.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.613+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff93401f020 con 0x7ff9401412d0 2024-06-13T11:37:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.811+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff9400d10f0 con 0x7ff9401412d0 2024-06-13T11:37:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.811+0000 7ff93d7fa640 1 -- 172.21.15.43:0/1789039560 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff9340172c0 con 0x7ff9401412d0 2024-06-13T11:37:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.813+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff92c06be30 msgr2=0x7ff92c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.813+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff92c06be30 0x7ff92c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff930009890 tx=0x7ff930008040 comp rx=0 tx=0).stop 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.813+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 msgr2=0x7ff940155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.813+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 0x7ff940155bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b3f0 tx=0x7ff93400b8b0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 shutdown_connections 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff92c06be30 0x7ff92c06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff940162640 0x7ff94013c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9401412d0 0x7ff940155bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 --2- 172.21.15.43:0/1789039560 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff94006f090 0x7ff94013ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:40.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 >> 172.21.15.43:0/1789039560 conn(0x7ff94006e030 msgr2=0x7ff94006e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:40.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 shutdown_connections 2024-06-13T11:37:40.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:40.814+0000 7ff946fc1640 1 -- 172.21.15.43:0/1789039560 wait complete. 2024-06-13T11:37:40.824 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-13T11:37:40.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:40.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-06-13T11:37:40.851 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:37:40.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:40.851 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-13T11:37:40.907 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:40.907 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:40.928 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:40.928 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:40.987 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:40.987 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:41.047 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T11:37:41.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.152+0000 7ff57e8ca640 1 Processor -- start 2024-06-13T11:37:41.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.152+0000 7ff57e8ca640 1 -- start start 2024-06-13T11:37:41.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff57e8ca640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 0x7ff57806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff57e8ca640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578162bf0 con 0x7ff57806e0c0 2024-06-13T11:37:41.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff57e8ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5780723b0 con 0x7ff57806e520 2024-06-13T11:37:41.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff57e8ca640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff5780afb30 con 0x7ff57815e0a0 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff5777fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff57806e0c0 0x7ff578161dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60152/0 (socket says 172.21.15.43:60152) 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff5777fe640 1 -- 172.21.15.43:0/4242595817 learned_addr learned my addr 172.21.15.43:0/4242595817 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff577fff640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 0x7ff57806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098125186 0 0) 0x7ff578162bf0 con 0x7ff57806e0c0 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.153+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff560003520 con 0x7ff57806e0c0 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285539396 0 0) 0x7ff5780723b0 con 0x7ff57806e520 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff578162bf0 con 0x7ff57806e520 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1969419010 0 0) 0x7ff560003520 con 0x7ff57806e0c0 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 msgr2=0x7ff57806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 0x7ff57806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 >> v1:172.21.15.53:6789/0 conn(0x7ff57806e520 legacy=0x7ff5781624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff578071b10 con 0x7ff57806e0c0 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7ff56c001670 con 0x7ff57806e0c0 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 >> v1:172.21.15.43:6789/0 conn(0x7ff57806e0c0 legacy=0x7ff578161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 0x7ff560003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff560004120 0x7ff560004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004d40 0x7ff5600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff56000bad0 con 0x7ff560004120 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff56000bc80 con 0x7ff560004d40 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff56000be80 con 0x7ff57815e0a0 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff560004120 0x7ff560004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff577fff640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 0x7ff560003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff57ce67640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004d40 0x7ff5600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff5777fe640 1 -- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 msgr2=0x7ff560003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:41.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff57815e0a0 0x7ff560003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff5777fe640 1 -- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004d40 msgr2=0x7ff5600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004d40 0x7ff5600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.154+0000 7ff5777fe640 1 -- 172.21.15.43:0/4242595817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff560003520 con 0x7ff560004120 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.155+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff560004120 0x7ff560004800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c0e0 tx=0x7ff560005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e83963f47f1c0e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.155+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c007c40 con 0x7ff560004120 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.155+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c02ae50 con 0x7ff560004120 2024-06-13T11:37:41.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.155+0000 7ff576ffd640 1 -- 172.21.15.43:0/4242595817 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c005d90 con 0x7ff560004120 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4242595817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff560004120 msgr2=0x7ff560004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4242595817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff560004120 0x7ff560004800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c0e0 tx=0x7ff560005830 comp rx=0 tx=0).stop 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57ce67640 1 -- 172.21.15.43:0/4242595817 reap_dead start 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4242595817 shutdown_connections 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4242595817 >> 172.21.15.43:0/4242595817 conn(0x7ff5780b21f0 msgr2=0x7ff5780b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4242595817 shutdown_connections 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.156+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4242595817 wait complete. 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.157+0000 7ff57e8ca640 1 Processor -- start 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.157+0000 7ff57e8ca640 1 -- start start 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57e8ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004120 0x7ff5781f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57e8ca640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 0x7ff578144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57e8ca640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff5781f3d60 0x7ff5781f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57e8ca640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780ae320 con 0x7ff57814a810 2024-06-13T11:37:41.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57e8ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780720d0 con 0x7ff560004120 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57e8ca640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff5780ae600 con 0x7ff5781f3d60 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 0x7ff578144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 0x7ff578144590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50570/0 (socket says 172.21.15.43:50570) 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 -- 172.21.15.43:0/4253669613 learned_addr learned my addr 172.21.15.43:0/4253669613 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff577fff640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004120 0x7ff5781f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff57ce67640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff5781f3d60 0x7ff5781f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 -- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff5781f3d60 msgr2=0x7ff5781f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff5781f3d60 0x7ff5781f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 -- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004120 msgr2=0x7ff5781f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004120 0x7ff5781f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.158+0000 7ff5777fe640 1 -- 172.21.15.43:0/4253669613 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5781f4c50 con 0x7ff57814a810 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.159+0000 7ff5777fe640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 0x7ff578144590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c0e0 tx=0x7ff56c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.159+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c041020 con 0x7ff57814a810 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.159+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c005a80 con 0x7ff57814a810 2024-06-13T11:37:41.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.159+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5781f82d0 con 0x7ff57814a810 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.159+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c005e50 con 0x7ff57814a810 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.159+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57814acd0 con 0x7ff57814a810 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.160+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57804ffb0 con 0x7ff57814a810 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.160+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff56c044020 con 0x7ff57814a810 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.161+0000 7ff574ff9640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff56406bfd0 0x7ff56406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.161+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff56c0ab3e0 con 0x7ff57814a810 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.161+0000 7ff577fff640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff56406bfd0 0x7ff56406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.162+0000 7ff577fff640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff56406bfd0 0x7ff56406e490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff568009a20 tx=0x7ff568008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:41.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.165+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff56c04b030 con 0x7ff57814a810 2024-06-13T11:37:41.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.363+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff5780b5ca0 con 0x7ff57814a810 2024-06-13T11:37:41.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.364+0000 7ff574ff9640 1 -- 172.21.15.43:0/4253669613 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff5781f82d0 con 0x7ff57814a810 2024-06-13T11:37:41.363 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.365+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff56406bfd0 msgr2=0x7ff56406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.365+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff56406bfd0 0x7ff56406e490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff568009a20 tx=0x7ff568008040 comp rx=0 tx=0).stop 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.365+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 msgr2=0x7ff578144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.365+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 0x7ff578144590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c0e0 tx=0x7ff56c001970 comp rx=0 tx=0).stop 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 shutdown_connections 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff56406bfd0 0x7ff56406e490 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff5781f3d60 0x7ff5781f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff57814a810 0x7ff578144590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 --2- 172.21.15.43:0/4253669613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff560004120 0x7ff5781f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 >> 172.21.15.43:0/4253669613 conn(0x7ff5780b21f0 msgr2=0x7ff578070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 shutdown_connections 2024-06-13T11:37:41.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.366+0000 7ff57e8ca640 1 -- 172.21.15.43:0/4253669613 wait complete. 2024-06-13T11:37:41.376 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-06-13T11:37:41.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:41.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-06-13T11:37:41.409 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:37:41.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:41.409 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-13T11:37:41.473 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:41.473 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:41.490 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:41.490 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:41.546 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:37:41.546 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:41.602 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T11:37:41.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 Processor -- start 2024-06-13T11:37:41.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 -- start start 2024-06-13T11:37:41.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40d2a90 0x7f30a40d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30a40abe00 0x7f30a40ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a40aa5d0 con 0x7f30a4155420 2024-06-13T11:37:41.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f30a40d3410 con 0x7f30a40abe00 2024-06-13T11:37:41.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.747+0000 7f30aafee640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f30a40aeb90 con 0x7f30a40d2a90 2024-06-13T11:37:41.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30a40abe00 0x7f30a40ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f30a40abe00 0x7f30a40ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50576/0 (socket says 172.21.15.43:50576) 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 -- 172.21.15.43:0/4035818459 learned_addr learned my addr 172.21.15.43:0/4035818459 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a3fff640 1 --2- 172.21.15.43:0/4035818459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40d2a90 0x7f30a40d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 -- 172.21.15.43:0/4035818459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40d2a90 msgr2=0x7f30a40d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 --2- 172.21.15.43:0/4035818459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40d2a90 0x7f30a40d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 -- 172.21.15.43:0/4035818459 >> v1:172.21.15.53:6789/0 conn(0x7f30a4155420 legacy=0x7f30a40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.748+0000 7f30a958b640 1 -- 172.21.15.43:0/4035818459 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a4155800 con 0x7f30a40abe00 2024-06-13T11:37:41.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30a958b640 1 --2- 172.21.15.43:0/4035818459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a40abe00 0x7f30a40ac240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e50 tx=0x7f309c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ca86a44d7487ea server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:41.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30a37fe640 1 -- 172.21.15.43:0/4035818459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c036070 con 0x7f30a40abe00 2024-06-13T11:37:41.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30a37fe640 1 -- 172.21.15.43:0/4035818459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c031600 con 0x7f30a40abe00 2024-06-13T11:37:41.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30a37fe640 1 -- 172.21.15.43:0/4035818459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0319d0 con 0x7f30a40abe00 2024-06-13T11:37:41.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30aafee640 1 -- 172.21.15.43:0/4035818459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a40abe00 msgr2=0x7f30a40ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30aafee640 1 --2- 172.21.15.43:0/4035818459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a40abe00 0x7f30a40ac240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e50 tx=0x7f309c02a710 comp rx=0 tx=0).stop 2024-06-13T11:37:41.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.749+0000 7f30aafee640 1 -- 172.21.15.43:0/4035818459 shutdown_connections 2024-06-13T11:37:41.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.750+0000 7f30aafee640 1 --2- 172.21.15.43:0/4035818459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a40abe00 0x7f30a40ac240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.750+0000 7f30aafee640 1 --2- 172.21.15.43:0/4035818459 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40d2a90 0x7f30a40d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.750+0000 7f30aafee640 1 -- 172.21.15.43:0/4035818459 >> 172.21.15.43:0/4035818459 conn(0x7f30a4067640 msgr2=0x7f30a40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:41.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.750+0000 7f30aafee640 1 -- 172.21.15.43:0/4035818459 shutdown_connections 2024-06-13T11:37:41.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.750+0000 7f30aafee640 1 -- 172.21.15.43:0/4035818459 wait complete. 2024-06-13T11:37:41.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.751+0000 7f30aafee640 1 Processor -- start 2024-06-13T11:37:41.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.751+0000 7f30aafee640 1 -- start start 2024-06-13T11:37:41.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30aafee640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40abe00 0x7f30a40b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30aafee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a40d2a90 0x7f30a40b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30aafee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 0x7f30a414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30aafee640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30a40aae30 con 0x7f30a4155420 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30aafee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f30a40aab50 con 0x7f30a40d2a90 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30aafee640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f30a40ab110 con 0x7f30a40abe00 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 0x7f30a414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 0x7f30a414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50590/0 (socket says 172.21.15.43:50590) 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 -- 172.21.15.43:0/2142121456 learned_addr learned my addr 172.21.15.43:0/2142121456 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a8d8a640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40abe00 0x7f30a40b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a3fff640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a40d2a90 0x7f30a40b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 -- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40abe00 msgr2=0x7f30a40b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40abe00 0x7f30a40b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 -- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a40d2a90 msgr2=0x7f30a40b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a40d2a90 0x7f30a40b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 -- 172.21.15.43:0/2142121456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a41594c0 con 0x7f30a4155420 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.752+0000 7f30a958b640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 0x7f30a414db10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e50 tx=0x7f309c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:41.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.753+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c036050 con 0x7f30a4155420 2024-06-13T11:37:41.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.753+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c042070 con 0x7f30a4155420 2024-06-13T11:37:41.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.753+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a41597a0 con 0x7f30a4155420 2024-06-13T11:37:41.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.753+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c009510 con 0x7f30a4155420 2024-06-13T11:37:41.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.753+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a40b0910 con 0x7f30a4155420 2024-06-13T11:37:41.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.754+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a404ffb0 con 0x7f30a4155420 2024-06-13T11:37:41.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.754+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f309c007bd0 con 0x7f30a4155420 2024-06-13T11:37:41.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.754+0000 7f30a17fa640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f308806be30 0x7f308806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:41.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.755+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f309c0abe90 con 0x7f30a4155420 2024-06-13T11:37:41.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.755+0000 7f30a8d8a640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f308806be30 0x7f308806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:41.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.755+0000 7f30a8d8a640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f308806be30 0x7f308806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30980016e0 tx=0x7f3098009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:41.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.759+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f309c079eb0 con 0x7f30a4155420 2024-06-13T11:37:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.961+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30a40ab920 con 0x7f30a4155420 2024-06-13T11:37:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.961+0000 7f30a17fa640 1 -- 172.21.15.43:0/2142121456 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f309c07e1b0 con 0x7f30a4155420 2024-06-13T11:37:41.961 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f308806be30 msgr2=0x7f308806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f308806be30 0x7f308806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30980016e0 tx=0x7f3098009040 comp rx=0 tx=0).stop 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 msgr2=0x7f30a414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 0x7f30a414db10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f309c009e50 tx=0x7f309c004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 shutdown_connections 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f308806be30 0x7f308806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30a4155420 0x7f30a414db10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30a40d2a90 0x7f30a40b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 --2- 172.21.15.43:0/2142121456 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f30a40abe00 0x7f30a40b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 >> 172.21.15.43:0/2142121456 conn(0x7f30a4067640 msgr2=0x7f30a40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:41.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 shutdown_connections 2024-06-13T11:37:41.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:41.963+0000 7f30aafee640 1 -- 172.21.15.43:0/2142121456 wait complete. 2024-06-13T11:37:41.973 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-06-13T11:37:41.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:41.974 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-06-13T11:37:42.000 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T11:37:42.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:42.000 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-13T11:37:42.056 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:42.056 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:42.076 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:42.076 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:42.136 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T11:37:42.137 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:37:42.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T11:37:42.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.303+0000 7fdb39c58640 1 Processor -- start 2024-06-13T11:37:42.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.303+0000 7fdb39c58640 1 -- start start 2024-06-13T11:37:42.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb39c58640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb34070810 0x7fdb3415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb39c58640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3415ce60 0x7fdb340cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb39c58640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb3413f440 con 0x7fdb3413f710 2024-06-13T11:37:42.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb39c58640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fdb34160ba0 con 0x7fdb34070810 2024-06-13T11:37:42.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb39c58640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdb34160300 con 0x7fdb3415ce60 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb34070810 0x7fdb3415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb34070810 0x7fdb3415fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50600/0 (socket says 172.21.15.43:50600) 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 -- 172.21.15.43:0/3277449076 learned_addr learned my addr 172.21.15.43:0/3277449076 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 -- 172.21.15.43:0/3277449076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3415ce60 msgr2=0x7fdb340cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 --2- 172.21.15.43:0/3277449076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3415ce60 0x7fdb340cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 -- 172.21.15.43:0/3277449076 >> v1:172.21.15.53:6789/0 conn(0x7fdb3413f710 legacy=0x7fdb34070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.304+0000 7fdb337fe640 1 -- 172.21.15.43:0/3277449076 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb341605e0 con 0x7fdb34070810 2024-06-13T11:37:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.305+0000 7fdb337fe640 1 --2- 172.21.15.43:0/3277449076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb3415fc70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009870 tx=0x7fdb2402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309aaf26b45809c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.305+0000 7fdb327fc640 1 -- 172.21.15.43:0/3277449076 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24037070 con 0x7fdb34070810 2024-06-13T11:37:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.305+0000 7fdb327fc640 1 -- 172.21.15.43:0/3277449076 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb24032440 con 0x7fdb34070810 2024-06-13T11:37:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.305+0000 7fdb327fc640 1 -- 172.21.15.43:0/3277449076 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24032810 con 0x7fdb34070810 2024-06-13T11:37:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 -- 172.21.15.43:0/3277449076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 msgr2=0x7fdb3415fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 --2- 172.21.15.43:0/3277449076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb3415fc70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009870 tx=0x7fdb2402a210 comp rx=0 tx=0).stop 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 -- 172.21.15.43:0/3277449076 shutdown_connections 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 --2- 172.21.15.43:0/3277449076 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3415ce60 0x7fdb340cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 --2- 172.21.15.43:0/3277449076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb3415fc70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 -- 172.21.15.43:0/3277449076 >> 172.21.15.43:0/3277449076 conn(0x7fdb3406f110 msgr2=0x7fdb3406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 -- 172.21.15.43:0/3277449076 shutdown_connections 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.306+0000 7fdb39c58640 1 -- 172.21.15.43:0/3277449076 wait complete. 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.307+0000 7fdb39c58640 1 Processor -- start 2024-06-13T11:37:42.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.307+0000 7fdb39c58640 1 -- start start 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb39c58640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb34153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb39c58640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3413f710 0x7fdb34152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb39c58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb3415ce60 0x7fdb341f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb39c58640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3413fb90 con 0x7fdb34070810 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb39c58640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340ceba0 con 0x7fdb3415ce60 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb39c58640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3415d2f0 con 0x7fdb3413f710 2024-06-13T11:37:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb34153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb34153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50612/0 (socket says 172.21.15.43:50612) 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 -- 172.21.15.43:0/2960106023 learned_addr learned my addr 172.21.15.43:0/2960106023 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb32ffd640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3413f710 0x7fdb34152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb33fff640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb3415ce60 0x7fdb341f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 -- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3413f710 msgr2=0x7fdb34152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3413f710 0x7fdb34152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 -- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb3415ce60 msgr2=0x7fdb341f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb3415ce60 0x7fdb341f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 -- 172.21.15.43:0/2960106023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb341f6340 con 0x7fdb34070810 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb33fff640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb3415ce60 0x7fdb341f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb337fe640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb34153880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009870 tx=0x7fdb240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.308+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24041070 con 0x7fdb34070810 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.309+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2403c870 con 0x7fdb34070810 2024-06-13T11:37:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.309+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb341f6620 con 0x7fdb34070810 2024-06-13T11:37:42.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.309+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24037040 con 0x7fdb34070810 2024-06-13T11:37:42.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.309+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3415ae10 con 0x7fdb34070810 2024-06-13T11:37:42.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.310+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3404ffb0 con 0x7fdb34070810 2024-06-13T11:37:42.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.310+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb24044070 con 0x7fdb34070810 2024-06-13T11:37:42.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.311+0000 7fdb1bfff640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.311+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdb240abcc0 con 0x7fdb34070810 2024-06-13T11:37:42.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.311+0000 7fdb32ffd640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.311+0000 7fdb32ffd640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fdb2006be30 0x7fdb2006e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb28007fd0 tx=0x7fdb28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:42.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.315+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb2407a340 con 0x7fdb34070810 2024-06-13T11:37:42.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.510+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdb34159e70 con 0x7fdb34070810 2024-06-13T11:37:42.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.510+0000 7fdb1bfff640 1 -- 172.21.15.43:0/2960106023 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fdb24079c40 con 0x7fdb34070810 2024-06-13T11:37:42.511 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fdb2006be30 msgr2=0x7fdb2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fdb2006be30 0x7fdb2006e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb28007fd0 tx=0x7fdb28009040 comp rx=0 tx=0).stop 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 msgr2=0x7fdb34153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb34153880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009870 tx=0x7fdb240046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 shutdown_connections 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fdb2006be30 0x7fdb2006e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb3415ce60 0x7fdb341f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fdb3413f710 0x7fdb34152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 --2- 172.21.15.43:0/2960106023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb34070810 0x7fdb34153880 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 >> 172.21.15.43:0/2960106023 conn(0x7fdb3406f110 msgr2=0x7fdb340cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:42.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 shutdown_connections 2024-06-13T11:37:42.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.513+0000 7fdb39c58640 1 -- 172.21.15.43:0/2960106023 wait complete. 2024-06-13T11:37:42.524 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-06-13T11:37:42.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:42.524 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-06-13T11:37:42.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T11:37:42.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:37:42.559 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-13T11:37:42.618 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-13T11:37:42.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:42.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.722+0000 7f43f0038640 1 Processor -- start 2024-06-13T11:37:42.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.722+0000 7f43f0038640 1 -- start start 2024-06-13T11:37:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43f0038640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43e8070810 0x7f43e815fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43f0038640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43e813f710 0x7f43e8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43f0038640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e813f440 con 0x7f43e815ce60 2024-06-13T11:37:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43f0038640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f43e8071130 con 0x7f43e8070810 2024-06-13T11:37:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43f0038640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f43e8160ba0 con 0x7f43e813f710 2024-06-13T11:37:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43eddd4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43e8070810 0x7f43e815fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43ee5d5640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f43e815ce60 0x7f43e80cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60166/0 (socket says 172.21.15.43:60166) 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43ee5d5640 1 -- 172.21.15.43:0/721776626 learned_addr learned my addr 172.21.15.43:0/721776626 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43eddd4640 1 -- 172.21.15.43:0/721776626 >> v2:172.21.15.53:3300/0 conn(0x7f43e813f710 msgr2=0x7f43e8070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43eddd4640 1 --2- 172.21.15.43:0/721776626 >> v2:172.21.15.53:3300/0 conn(0x7f43e813f710 0x7f43e8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43eddd4640 1 -- 172.21.15.43:0/721776626 >> v1:172.21.15.43:6789/0 conn(0x7f43e815ce60 legacy=0x7f43e80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.723+0000 7f43eddd4640 1 -- 172.21.15.43:0/721776626 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e8160300 con 0x7f43e8070810 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.724+0000 7f43eddd4640 1 --2- 172.21.15.43:0/721776626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e815fc70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f43e806c1f0 tx=0x7f43e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889214e63aee141d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.724+0000 7f43ecdd2640 1 -- 172.21.15.43:0/721776626 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4037070 con 0x7f43e8070810 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.724+0000 7f43ecdd2640 1 -- 172.21.15.43:0/721776626 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4032440 con 0x7f43e8070810 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.724+0000 7f43ecdd2640 1 -- 172.21.15.43:0/721776626 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4032810 con 0x7f43e8070810 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 -- 172.21.15.43:0/721776626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 msgr2=0x7f43e815fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 --2- 172.21.15.43:0/721776626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e815fc70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f43e806c1f0 tx=0x7f43e402a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 -- 172.21.15.43:0/721776626 shutdown_connections 2024-06-13T11:37:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 --2- 172.21.15.43:0/721776626 >> v2:172.21.15.53:3300/0 conn(0x7f43e813f710 0x7f43e8070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 --2- 172.21.15.43:0/721776626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e815fc70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 -- 172.21.15.43:0/721776626 >> 172.21.15.43:0/721776626 conn(0x7f43e806f110 msgr2=0x7f43e806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 -- 172.21.15.43:0/721776626 shutdown_connections 2024-06-13T11:37:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.725+0000 7f43f0038640 1 -- 172.21.15.43:0/721776626 wait complete. 2024-06-13T11:37:42.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.726+0000 7f43f0038640 1 Processor -- start 2024-06-13T11:37:42.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.726+0000 7f43f0038640 1 -- start start 2024-06-13T11:37:42.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43f0038640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e81f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43f0038640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43e813f710 0x7f43e81557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43f0038640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43e815ce60 0x7f43e8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43f0038640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80ceba0 con 0x7f43e8070810 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43f0038640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f43e81608c0 con 0x7f43e815ce60 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43f0038640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f43e813fb90 con 0x7f43e813f710 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e81f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e81f3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50628/0 (socket says 172.21.15.43:50628) 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 -- 172.21.15.43:0/575077514 learned_addr learned my addr 172.21.15.43:0/575077514 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43ee5d5640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43e815ce60 0x7f43e8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43ed5d3640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43e813f710 0x7f43e81557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 -- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43e813f710 msgr2=0x7f43e81557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43e813f710 0x7f43e81557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 -- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43e815ce60 msgr2=0x7f43e8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43e815ce60 0x7f43e8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 -- 172.21.15.43:0/575077514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e80cb710 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43ee5d5640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43e815ce60 0x7f43e8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43ed5d3640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43e813f710 0x7f43e81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.727+0000 7f43eddd4640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e81f3930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43e4000c00 tx=0x7f43e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.728+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4037040 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.728+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4042070 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.728+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4030bd0 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.728+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e80cb9f0 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.728+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e80cbfb0 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.729+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e804ffb0 con 0x7f43e8070810 2024-06-13T11:37:42.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.729+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43e4047460 con 0x7f43e8070810 2024-06-13T11:37:42.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.730+0000 7f43de7fc640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f43cc06be30 0x7f43cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:42.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.730+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f43e40abde0 con 0x7f43e8070810 2024-06-13T11:37:42.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.730+0000 7f43ed5d3640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f43cc06be30 0x7f43cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:42.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.730+0000 7f43ed5d3640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f43cc06be30 0x7f43cc06e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ce340 tx=0x7f43d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:42.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.734+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f43e4032e20 con 0x7f43e8070810 2024-06-13T11:37:42.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.955+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43e80716a0 con 0x7f43e8070810 2024-06-13T11:37:42.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.955+0000 7f43de7fc640 1 -- 172.21.15.43:0/575077514 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f43e4045360 con 0x7f43e8070810 2024-06-13T11:37:42.955 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:42.956 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:42.956 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f43cc06be30 msgr2=0x7f43cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f43cc06be30 0x7f43cc06e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ce340 tx=0x7f43d8008040 comp rx=0 tx=0).stop 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 msgr2=0x7f43e81f3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e81f3930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43e4000c00 tx=0x7f43e40046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 shutdown_connections 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f43cc06be30 0x7f43cc06e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43e815ce60 0x7f43e8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f43e813f710 0x7f43e81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 --2- 172.21.15.43:0/575077514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43e8070810 0x7f43e81f3930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 >> 172.21.15.43:0/575077514 conn(0x7f43e806f110 msgr2=0x7f43e806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 shutdown_connections 2024-06-13T11:37:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:42.957+0000 7f43f0038640 1 -- 172.21.15.43:0/575077514 wait complete. 2024-06-13T11:37:42.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:43.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.072+0000 7f299f626640 1 Processor -- start 2024-06-13T11:37:43.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.072+0000 7f299f626640 1 -- start start 2024-06-13T11:37:43.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299f626640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29981604e0 0x7f299806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299f626640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2998160970 0x7f299806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299f626640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2998142150 con 0x7f29981565f0 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299f626640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f2998142710 con 0x7f2998160970 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299f626640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2998160050 con 0x7f29981604e0 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299d3c2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f29981565f0 0x7f2998141850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43050/0 (socket says 172.21.15.43:43050) 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299d3c2640 1 -- 172.21.15.43:0/3841986363 learned_addr learned my addr 172.21.15.43:0/3841986363 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299dbc3640 1 --2- 172.21.15.43:0/3841986363 >> v2:172.21.15.43:3300/0 conn(0x7f2998160970 0x7f299806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299cbc1640 1 --2- 172.21.15.43:0/3841986363 >> v2:172.21.15.53:3300/0 conn(0x7f29981604e0 0x7f299806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299dbc3640 1 -- 172.21.15.43:0/3841986363 >> v2:172.21.15.53:3300/0 conn(0x7f29981604e0 msgr2=0x7f299806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299dbc3640 1 --2- 172.21.15.43:0/3841986363 >> v2:172.21.15.53:3300/0 conn(0x7f29981604e0 0x7f299806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299dbc3640 1 -- 172.21.15.43:0/3841986363 >> v1:172.21.15.43:6789/0 conn(0x7f29981565f0 legacy=0x7f2998141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f298ffff640 1 -- 172.21.15.43:0/3841986363 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322627735 0 0) 0x7f2998142150 con 0x7f29981565f0 2024-06-13T11:37:43.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299dbc3640 1 -- 172.21.15.43:0/3841986363 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2998142430 con 0x7f2998160970 2024-06-13T11:37:43.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.073+0000 7f299cbc1640 1 --2- 172.21.15.43:0/3841986363 >> v2:172.21.15.53:3300/0 conn(0x7f29981604e0 0x7f299806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.074+0000 7f299dbc3640 1 --2- 172.21.15.43:0/3841986363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998160970 0x7f299806f090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f299815d7c0 tx=0x7f299002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1f14593e681908 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.074+0000 7f298ffff640 1 -- 172.21.15.43:0/3841986363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990007740 con 0x7f2998160970 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.074+0000 7f298ffff640 1 -- 172.21.15.43:0/3841986363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29900078e0 con 0x7f2998160970 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.074+0000 7f298ffff640 1 -- 172.21.15.43:0/3841986363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990007cb0 con 0x7f2998160970 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 -- 172.21.15.43:0/3841986363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998160970 msgr2=0x7f299806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 --2- 172.21.15.43:0/3841986363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998160970 0x7f299806f090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f299815d7c0 tx=0x7f299002a680 comp rx=0 tx=0).stop 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 -- 172.21.15.43:0/3841986363 shutdown_connections 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 --2- 172.21.15.43:0/3841986363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2998160970 0x7f299806f090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 --2- 172.21.15.43:0/3841986363 >> v2:172.21.15.53:3300/0 conn(0x7f29981604e0 0x7f299806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 -- 172.21.15.43:0/3841986363 >> 172.21.15.43:0/3841986363 conn(0x7f299806e030 msgr2=0x7f299806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 -- 172.21.15.43:0/3841986363 shutdown_connections 2024-06-13T11:37:43.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.075+0000 7f299f626640 1 -- 172.21.15.43:0/3841986363 wait complete. 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.076+0000 7f299f626640 1 Processor -- start 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.076+0000 7f299f626640 1 -- start start 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299f626640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 0x7f29981452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299f626640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29981604e0 0x7f299806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299f626640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2998160970 0x7f299813d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299f626640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2998156b50 con 0x7f29981565f0 2024-06-13T11:37:43.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299f626640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f29981569d0 con 0x7f29981604e0 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299f626640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f29980b21f0 con 0x7f2998160970 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 0x7f29981452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 0x7f29981452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57488/0 (socket says 172.21.15.43:57488) 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 -- 172.21.15.43:0/4145283285 learned_addr learned my addr 172.21.15.43:0/4145283285 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299cbc1640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29981604e0 0x7f299806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299dbc3640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2998160970 0x7f299813d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 -- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2998160970 msgr2=0x7f299813d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2998160970 0x7f299813d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 -- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29981604e0 msgr2=0x7f299806ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29981604e0 0x7f299806ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299d3c2640 1 -- 172.21.15.43:0/4145283285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2998144ad0 con 0x7f29981565f0 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.077+0000 7f299dbc3640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2998160970 0x7f299813d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.078+0000 7f299d3c2640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 0x7f29981452f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f299400c4d0 tx=0x7f299400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.078+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994018070 con 0x7f29981565f0 2024-06-13T11:37:43.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.078+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2994007500 con 0x7f29981565f0 2024-06-13T11:37:43.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.078+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2998144db0 con 0x7f29981565f0 2024-06-13T11:37:43.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.078+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994004a20 con 0x7f29981565f0 2024-06-13T11:37:43.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.078+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29980adb50 con 0x7f29981565f0 2024-06-13T11:37:43.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.079+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2998072c60 con 0x7f29981565f0 2024-06-13T11:37:43.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.079+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f299401b070 con 0x7f29981565f0 2024-06-13T11:37:43.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.080+0000 7f298dffb640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f297c06be30 0x7f297c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.080+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f299408a520 con 0x7f29981565f0 2024-06-13T11:37:43.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.080+0000 7f299cbc1640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f297c06be30 0x7f297c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.081+0000 7f299cbc1640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f297c06be30 0x7f297c06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29980ab560 tx=0x7f2988008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.085+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2998072c60 con 0x7f29981565f0 2024-06-13T11:37:43.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.311+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f299804ffb0 con 0x7f29981565f0 2024-06-13T11:37:43.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.311+0000 7f298dffb640 1 -- 172.21.15.43:0/4145283285 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f2994058b90 con 0x7f29981565f0 2024-06-13T11:37:43.312 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:43.312 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:43.312 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f297c06be30 msgr2=0x7f297c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f297c06be30 0x7f297c06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29980ab560 tx=0x7f2988008040 comp rx=0 tx=0).stop 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 msgr2=0x7f29981452f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 0x7f29981452f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f299400c4d0 tx=0x7f299400c990 comp rx=0 tx=0).stop 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 shutdown_connections 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f297c06be30 0x7f297c06e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f2998160970 0x7f299813d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29981604e0 0x7f299806ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 --2- 172.21.15.43:0/4145283285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29981565f0 0x7f29981452f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.313+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 >> 172.21.15.43:0/4145283285 conn(0x7f299806e030 msgr2=0x7f299813e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:43.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.314+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 shutdown_connections 2024-06-13T11:37:43.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.314+0000 7f299f626640 1 -- 172.21.15.43:0/4145283285 wait complete. 2024-06-13T11:37:43.325 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:43.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.430+0000 7fea5dc4c640 1 Processor -- start 2024-06-13T11:37:43.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.430+0000 7fea5dc4c640 1 -- start start 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea5dc4c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea58155420 0x7fea580ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea5dc4c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea580ae9c0 0x7fea580d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea5dc4c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea580d2fd0 0x7fea58161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea5dc4c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fea580aa5d0 con 0x7fea580ae9c0 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea5dc4c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fea58155800 con 0x7fea58155420 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea5dc4c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fea580aa870 con 0x7fea580d2fd0 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea56ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea580ae9c0 0x7fea580d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea56ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fea580ae9c0 0x7fea580d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57492/0 (socket says 172.21.15.43:57492) 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.431+0000 7fea56ffd640 1 -- 172.21.15.43:0/3353380655 learned_addr learned my addr 172.21.15.43:0/3353380655 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea577fe640 1 --2- 172.21.15.43:0/3353380655 >> v2:172.21.15.53:3300/0 conn(0x7fea58155420 0x7fea580ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea56ffd640 1 -- 172.21.15.43:0/3353380655 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea580d2fd0 msgr2=0x7fea58161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea57fff640 1 --2- 172.21.15.43:0/3353380655 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea580d2fd0 0x7fea58161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea56ffd640 1 --2- 172.21.15.43:0/3353380655 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea580d2fd0 0x7fea58161ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea56ffd640 1 -- 172.21.15.43:0/3353380655 >> v2:172.21.15.53:3300/0 conn(0x7fea58155420 msgr2=0x7fea580ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea56ffd640 1 --2- 172.21.15.43:0/3353380655 >> v2:172.21.15.53:3300/0 conn(0x7fea58155420 0x7fea580ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea56ffd640 1 -- 172.21.15.43:0/3353380655 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea580aab50 con 0x7fea580ae9c0 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea577fe640 1 --2- 172.21.15.43:0/3353380655 >> v2:172.21.15.53:3300/0 conn(0x7fea58155420 0x7fea580ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.432+0000 7fea56ffd640 1 --2- 172.21.15.43:0/3353380655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea580d2a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea580d2a60 tx=0x7fea4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7fdf9d1867aca5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea567fc640 1 -- 172.21.15.43:0/3353380655 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c037070 con 0x7fea580ae9c0 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea567fc640 1 -- 172.21.15.43:0/3353380655 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c032440 con 0x7fea580ae9c0 2024-06-13T11:37:43.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea567fc640 1 -- 172.21.15.43:0/3353380655 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c032810 con 0x7fea580ae9c0 2024-06-13T11:37:43.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 -- 172.21.15.43:0/3353380655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 msgr2=0x7fea580d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/3353380655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea580d2a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea580d2a60 tx=0x7fea4c02a1e0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 -- 172.21.15.43:0/3353380655 shutdown_connections 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/3353380655 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea580d2fd0 0x7fea58161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/3353380655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea580d2a90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/3353380655 >> v2:172.21.15.53:3300/0 conn(0x7fea58155420 0x7fea580ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 -- 172.21.15.43:0/3353380655 >> 172.21.15.43:0/3353380655 conn(0x7fea58067640 msgr2=0x7fea580d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 -- 172.21.15.43:0/3353380655 shutdown_connections 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.433+0000 7fea5dc4c640 1 -- 172.21.15.43:0/3353380655 wait complete. 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 Processor -- start 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 -- start start 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea581588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea580d2fd0 0x7fea5814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea58155420 0x7fea5814fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea580ab630 con 0x7fea580ae9c0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fea580ab110 con 0x7fea580d2fd0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.435+0000 7fea5dc4c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fea580adfb0 con 0x7fea58155420 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea581588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea581588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57494/0 (socket says 172.21.15.43:57494) 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 -- 172.21.15.43:0/4144185449 learned_addr learned my addr 172.21.15.43:0/4144185449 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea56ffd640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea580d2fd0 0x7fea5814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea57fff640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea58155420 0x7fea5814fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 -- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea58155420 msgr2=0x7fea5814fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea58155420 0x7fea5814fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 -- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea580d2fd0 msgr2=0x7fea5814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea580d2fd0 0x7fea5814af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 -- 172.21.15.43:0/4144185449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58155ed0 con 0x7fea580ae9c0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea577fe640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea581588e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c7f0 tx=0x7fea4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48015070 con 0x7fea580ae9c0 2024-06-13T11:37:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea48007820 con 0x7fea580ae9c0 2024-06-13T11:37:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea581561b0 con 0x7fea580ae9c0 2024-06-13T11:37:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48007bd0 con 0x7fea580ae9c0 2024-06-13T11:37:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.436+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea58156770 con 0x7fea580ae9c0 2024-06-13T11:37:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.437+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5804ffb0 con 0x7fea580ae9c0 2024-06-13T11:37:43.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.438+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea48018070 con 0x7fea580ae9c0 2024-06-13T11:37:43.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.438+0000 7fea3ffff640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea4406be30 0x7fea4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.438+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fea4808afc0 con 0x7fea580ae9c0 2024-06-13T11:37:43.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.439+0000 7fea56ffd640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea4406be30 0x7fea4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.439+0000 7fea56ffd640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea4406be30 0x7fea4406e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea4c034000 tx=0x7fea4c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.447+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fea48058fe0 con 0x7fea580ae9c0 2024-06-13T11:37:43.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.632+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea580ab920 con 0x7fea580ae9c0 2024-06-13T11:37:43.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.634+0000 7fea3ffff640 1 -- 172.21.15.43:0/4144185449 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fea4805d2e0 con 0x7fea580ae9c0 2024-06-13T11:37:43.634 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:43.635 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea4406be30 msgr2=0x7fea4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea4406be30 0x7fea4406e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea4c034000 tx=0x7fea4c02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 msgr2=0x7fea581588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea581588e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c7f0 tx=0x7fea4800ccb0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 shutdown_connections 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fea4406be30 0x7fea4406e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fea58155420 0x7fea5814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea580d2fd0 0x7fea5814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 --2- 172.21.15.43:0/4144185449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea580ae9c0 0x7fea581588e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 >> 172.21.15.43:0/4144185449 conn(0x7fea58067640 msgr2=0x7fea580720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 shutdown_connections 2024-06-13T11:37:43.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.636+0000 7fea5dc4c640 1 -- 172.21.15.43:0/4144185449 wait complete. 2024-06-13T11:37:43.648 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-13T11:37:43.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:43.651 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:37:43.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:37:43.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.754+0000 7f90f542c640 1 Processor -- start 2024-06-13T11:37:43.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.754+0000 7f90f542c640 1 -- start start 2024-06-13T11:37:43.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.755+0000 7f90f542c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f90f00d2a90 0x7f90f00d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.755+0000 7f90f542c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00abe00 0x7f90f00ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.755+0000 7f90f542c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90f00aa5d0 con 0x7f90f0155420 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.755+0000 7f90f542c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f90f00d3440 con 0x7f90f00d2a90 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.755+0000 7f90f542c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f90f00aeb90 con 0x7f90f00abe00 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ee7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f90f00d2a90 0x7f90f00d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00abe00 0x7f90f00ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90eeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f90f0155420 0x7f90f00ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.43:36624/0 (socket says 172.21.15.43:36624) 2024-06-13T11:37:43.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90eeffd640 1 -- 172.21.15.43:0/2035273534 learned_addr learned my addr 172.21.15.43:0/2035273534 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ef7fe640 1 -- 172.21.15.43:0/2035273534 >> v2:172.21.15.53:3300/0 conn(0x7f90f00d2a90 msgr2=0x7f90f00d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ef7fe640 1 --2- 172.21.15.43:0/2035273534 >> v2:172.21.15.53:3300/0 conn(0x7f90f00d2a90 0x7f90f00d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ef7fe640 1 -- 172.21.15.43:0/2035273534 >> v1:172.21.15.53:6789/0 conn(0x7f90f0155420 legacy=0x7f90f00ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ef7fe640 1 -- 172.21.15.43:0/2035273534 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f0155800 con 0x7f90f00abe00 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.756+0000 7f90ee7fc640 1 --2- 172.21.15.43:0/2035273534 >> v2:172.21.15.53:3300/0 conn(0x7f90f00d2a90 0x7f90f00d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.757+0000 7f90ef7fe640 1 --2- 172.21.15.43:0/2035273534 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00abe00 0x7f90f00ac240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90f00aed70 tx=0x7f90e802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2137c50223ef9df3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.757+0000 7f90edffb640 1 -- 172.21.15.43:0/2035273534 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e802ae60 con 0x7f90f00abe00 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.757+0000 7f90edffb640 1 -- 172.21.15.43:0/2035273534 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e8007740 con 0x7f90f00abe00 2024-06-13T11:37:43.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.757+0000 7f90edffb640 1 -- 172.21.15.43:0/2035273534 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8007b10 con 0x7f90f00abe00 2024-06-13T11:37:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 -- 172.21.15.43:0/2035273534 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00abe00 msgr2=0x7f90f00ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 --2- 172.21.15.43:0/2035273534 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00abe00 0x7f90f00ac240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90f00aed70 tx=0x7f90e802a640 comp rx=0 tx=0).stop 2024-06-13T11:37:43.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 -- 172.21.15.43:0/2035273534 shutdown_connections 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 --2- 172.21.15.43:0/2035273534 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00abe00 0x7f90f00ac240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 --2- 172.21.15.43:0/2035273534 >> v2:172.21.15.53:3300/0 conn(0x7f90f00d2a90 0x7f90f00d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 -- 172.21.15.43:0/2035273534 >> 172.21.15.43:0/2035273534 conn(0x7f90f0067640 msgr2=0x7f90f00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 -- 172.21.15.43:0/2035273534 shutdown_connections 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.758+0000 7f90f542c640 1 -- 172.21.15.43:0/2035273534 wait complete. 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.759+0000 7f90f542c640 1 Processor -- start 2024-06-13T11:37:43.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.759+0000 7f90f542c640 1 -- start start 2024-06-13T11:37:43.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90f542c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f00abe00 0x7f90f0141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90f542c640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00d2a90 0x7f90f014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90f542c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 0x7f90f00d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90f542c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90f00aae30 con 0x7f90f0155420 2024-06-13T11:37:43.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90f542c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f90f00aab50 con 0x7f90f00abe00 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90f542c640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f90f00ab110 con 0x7f90f00d2a90 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 0x7f90f00d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 0x7f90f00d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57502/0 (socket says 172.21.15.43:57502) 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 -- 172.21.15.43:0/169681452 learned_addr learned my addr 172.21.15.43:0/169681452 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ee7fc640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00d2a90 0x7f90f014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90eeffd640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f00abe00 0x7f90f0141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 -- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00d2a90 msgr2=0x7f90f014b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00d2a90 0x7f90f014b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 -- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f00abe00 msgr2=0x7f90f0141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f00abe00 0x7f90f0141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.760+0000 7f90ef7fe640 1 -- 172.21.15.43:0/169681452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f0148990 con 0x7f90f0155420 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.761+0000 7f90ef7fe640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 0x7f90f00d1a80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90e802ac30 tx=0x7f90e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.761+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e803f070 con 0x7f90f0155420 2024-06-13T11:37:43.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.761+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e80319c0 con 0x7f90f0155420 2024-06-13T11:37:43.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.761+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f0148c70 con 0x7f90f0155420 2024-06-13T11:37:43.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.761+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8031b90 con 0x7f90f0155420 2024-06-13T11:37:43.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.761+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f0149230 con 0x7f90f0155420 2024-06-13T11:37:43.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.762+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f004ffb0 con 0x7f90f0155420 2024-06-13T11:37:43.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.763+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90e803b410 con 0x7f90f0155420 2024-06-13T11:37:43.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.763+0000 7f90d77fe640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f90dc06be30 0x7f90dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:43.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.763+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f90e80ac7f0 con 0x7f90f0155420 2024-06-13T11:37:43.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.763+0000 7f90eeffd640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f90dc06be30 0x7f90dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:43.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.764+0000 7f90eeffd640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f90dc06be30 0x7f90dc06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90e0005880 tx=0x7f90e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:43.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.767+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f90e807ae50 con 0x7f90f0155420 2024-06-13T11:37:43.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.994+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90f014ae30 con 0x7f90f0155420 2024-06-13T11:37:43.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.995+0000 7f90d77fe640 1 -- 172.21.15.43:0/169681452 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f90e807a750 con 0x7f90f0155420 2024-06-13T11:37:43.995 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:43.995 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:43.996 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:43.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f90dc06be30 msgr2=0x7f90dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f90dc06be30 0x7f90dc06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90e0005880 tx=0x7f90e0009040 comp rx=0 tx=0).stop 2024-06-13T11:37:43.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 msgr2=0x7f90f00d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 0x7f90f00d1a80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90e802ac30 tx=0x7f90e8004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 shutdown_connections 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f90dc06be30 0x7f90dc06e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f0155420 0x7f90f00d1a80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f90f00d2a90 0x7f90f014b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 --2- 172.21.15.43:0/169681452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f00abe00 0x7f90f0141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 >> 172.21.15.43:0/169681452 conn(0x7f90f0067640 msgr2=0x7f90f0071820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 shutdown_connections 2024-06-13T11:37:43.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:43.997+0000 7f90f542c640 1 -- 172.21.15.43:0/169681452 wait complete. 2024-06-13T11:37:44.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:44.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.154+0000 7f5ac1963640 1 Processor -- start 2024-06-13T11:37:44.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.154+0000 7f5ac1963640 1 -- start start 2024-06-13T11:37:44.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5ac1963640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5abc0cf580 0x7f5abc071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5ac1963640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc072b90 0x7f5abc0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5ac1963640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc0b09f0 con 0x7f5abc15c250 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5ac1963640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5abc072700 con 0x7f5abc0cf580 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5ac1963640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc071dd0 con 0x7f5abc072b90 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5abaffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5abc15c250 0x7f5abc0cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43064/0 (socket says 172.21.15.43:43064) 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5abaffd640 1 -- 172.21.15.43:0/749831367 learned_addr learned my addr 172.21.15.43:0/749831367 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.155+0000 7f5abb7fe640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc072b90 0x7f5abc0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/749831367 >> v2:172.21.15.53:3300/0 conn(0x7f5abc0cf580 0x7f5abc071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872160222 0 0) 0x7f5abc0b09f0 con 0x7f5abc15c250 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5abc15c250 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 328649212 0 0) 0x7f5aa8003520 con 0x7f5abc15c250 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc072b90 msgr2=0x7f5abc0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc072b90 0x7f5abc0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 >> v2:172.21.15.53:3300/0 conn(0x7f5abc0cf580 msgr2=0x7f5abc071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 --2- 172.21.15.43:0/749831367 >> v2:172.21.15.53:3300/0 conn(0x7f5abc0cf580 0x7f5abc071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0720b0 con 0x7f5abc15c250 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f5aac001670 con 0x7f5abc15c250 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 >> v1:172.21.15.43:6789/0 conn(0x7f5abc15c250 legacy=0x7f5abc0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5aa80039b0 0x7f5aa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc072700 con 0x7f5aa8004800 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc071dd0 con 0x7f5aa80051c0 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa800bf00 con 0x7f5aa80039b0 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5abb7fe640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc072b90 0x7f5abc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5abaffd640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5aa80039b0 0x7f5aa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5abb7fe640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 -- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5aa80039b0 msgr2=0x7f5aa8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5aa80039b0 0x7f5aa8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 -- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5aa80051c0 msgr2=0x7f5aa800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5ab3fff640 1 -- 172.21.15.43:0/749831367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa8003520 con 0x7f5aa8004800 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.156+0000 7f5abb7fe640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.157+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009af0 tx=0x7f5aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf461d54cb5ddc0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.157+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4036070 con 0x7f5aa8004800 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.157+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa4031400 con 0x7f5aa8004800 2024-06-13T11:37:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.157+0000 7f5aba7fc640 1 -- 172.21.15.43:0/749831367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4009690 con 0x7f5aa8004800 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5ac1963640 1 -- 172.21.15.43:0/749831367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 msgr2=0x7f5aa8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5ac1963640 1 --2- 172.21.15.43:0/749831367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009af0 tx=0x7f5aa8005830 comp rx=0 tx=0).stop 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5abb7fe640 1 -- 172.21.15.43:0/749831367 reap_dead start 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5ac1963640 1 -- 172.21.15.43:0/749831367 shutdown_connections 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5ac1963640 1 -- 172.21.15.43:0/749831367 >> 172.21.15.43:0/749831367 conn(0x7f5abc0b14b0 msgr2=0x7f5abc0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5ac1963640 1 -- 172.21.15.43:0/749831367 shutdown_connections 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.158+0000 7f5ac1963640 1 -- 172.21.15.43:0/749831367 wait complete. 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 Processor -- start 2024-06-13T11:37:44.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 -- start start 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5abc0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc154fb0 0x7f5abc0ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5abc0ac6e0 0x7f5abc070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc15c7b0 con 0x7f5aa8004800 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc15c630 con 0x7f5abc0ac6e0 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5ac1963640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc0b0e30 con 0x7f5abc154fb0 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5abaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5abc0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.160+0000 7f5abaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5abc0aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57516/0 (socket says 172.21.15.43:57516) 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 -- 172.21.15.43:0/2882607389 learned_addr learned my addr 172.21.15.43:0/2882607389 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abb7fe640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5abc0ac6e0 0x7f5abc070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc154fb0 0x7f5abc0ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 -- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc154fb0 msgr2=0x7f5abc0ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc154fb0 0x7f5abc0ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 -- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5abc0ac6e0 msgr2=0x7f5abc070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5abc0ac6e0 0x7f5abc070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 -- 172.21.15.43:0/2882607389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0af1f0 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abb7fe640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5abc0ac6e0 0x7f5abc070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5abaffd640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5abc0aebf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5aac004f70 tx=0x7f5aac0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00f750 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aac018070 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00fb50 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc0af4d0 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.161+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc0afa90 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.162+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5abc04ffb0 con 0x7f5aa8004800 2024-06-13T11:37:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.163+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5aac00fcf0 con 0x7f5aa8004800 2024-06-13T11:37:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.163+0000 7f5ab8ff9640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5a9c06be30 0x7f5a9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.163+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5aac08b0b0 con 0x7f5aa8004800 2024-06-13T11:37:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.164+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5a9c06be30 0x7f5a9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.164+0000 7f5ab3fff640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5a9c06be30 0x7f5a9c06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4033000 tx=0x7f5aa4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.172+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5aac059720 con 0x7f5aa8004800 2024-06-13T11:37:44.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.394+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5abc068610 con 0x7f5aa8004800 2024-06-13T11:37:44.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.394+0000 7f5ab8ff9640 1 -- 172.21.15.43:0/2882607389 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f5aac059020 con 0x7f5aa8004800 2024-06-13T11:37:44.395 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:44.395 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/4003217062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":4003217062},{"type":"v1","addr":"172.21.15.53:6837","nonce":4003217062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1967767129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1967767129},{"type":"v1","addr":"172.21.15.43:6834","nonce":1967767129}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2123470958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":2123470958},{"type":"v1","addr":"172.21.15.43:6835","nonce":2123470958}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:07.166526+0000","modified":"2024-06-13T11:37:20.214302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3684318911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3684318911},{"type":"v1","addr":"172.21.15.53:6835","nonce":3684318911}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-06-13T11:37:44.395 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 9 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5a9c06be30 msgr2=0x7f5a9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5a9c06be30 0x7f5a9c06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4033000 tx=0x7f5aa4008030 comp rx=0 tx=0).stop 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 msgr2=0x7f5abc0aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5abc0aebf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5aac004f70 tx=0x7f5aac0074f0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 shutdown_connections 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5a9c06be30 0x7f5a9c06e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5abc0ac6e0 0x7f5abc070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5abc154fb0 0x7f5abc0ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 --2- 172.21.15.43:0/2882607389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa8004800 0x7f5abc0aebf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 >> 172.21.15.43:0/2882607389 conn(0x7f5abc0b14b0 msgr2=0x7f5abc074830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 shutdown_connections 2024-06-13T11:37:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.396+0000 7f5ac1963640 1 -- 172.21.15.43:0/2882607389 wait complete. 2024-06-13T11:37:44.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:44.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.511+0000 7f5d77e76640 1 Processor -- start 2024-06-13T11:37:44.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.511+0000 7f5d77e76640 1 -- start start 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d77e76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d700d2a90 0x7f5d700d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d77e76640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d700aa5d0 con 0x7f5d70155420 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d77e76640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d700aeb90 con 0x7f5d700abe00 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d77e76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5d700d3440 con 0x7f5d700d2a90 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d75c12640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5d70155420 0x7f5d700ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43070/0 (socket says 172.21.15.43:43070) 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d75c12640 1 -- 172.21.15.43:0/3988503070 learned_addr learned my addr 172.21.15.43:0/3988503070 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d75411640 1 --2- 172.21.15.43:0/3988503070 >> v2:172.21.15.53:3300/0 conn(0x7f5d700d2a90 0x7f5d700d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d74c10640 1 -- 172.21.15.43:0/3988503070 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952211400 0 0) 0x7f5d700aa5d0 con 0x7f5d70155420 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.512+0000 7f5d74c10640 1 -- 172.21.15.43:0/3988503070 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d5c003520 con 0x7f5d70155420 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.513+0000 7f5d75411640 1 -- 172.21.15.43:0/3988503070 >> v1:172.21.15.53:6789/0 conn(0x7f5d700abe00 legacy=0x7f5d700ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.513+0000 7f5d75411640 1 -- 172.21.15.43:0/3988503070 >> v1:172.21.15.43:6789/0 conn(0x7f5d70155420 legacy=0x7f5d700ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.513+0000 7f5d75411640 1 -- 172.21.15.43:0/3988503070 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d70155800 con 0x7f5d700d2a90 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.513+0000 7f5d75411640 1 --2- 172.21.15.43:0/3988503070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700d2a90 0x7f5d700d2f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097a0 tx=0x7f5d6402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=677e4db18c45fc36 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d74c10640 1 -- 172.21.15.43:0/3988503070 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64037070 con 0x7f5d700d2a90 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d74c10640 1 -- 172.21.15.43:0/3988503070 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64032440 con 0x7f5d700d2a90 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d74c10640 1 -- 172.21.15.43:0/3988503070 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d640327f0 con 0x7f5d700d2a90 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 -- 172.21.15.43:0/3988503070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700d2a90 msgr2=0x7f5d700d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 --2- 172.21.15.43:0/3988503070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700d2a90 0x7f5d700d2f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097a0 tx=0x7f5d6402a230 comp rx=0 tx=0).stop 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 -- 172.21.15.43:0/3988503070 shutdown_connections 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 --2- 172.21.15.43:0/3988503070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700d2a90 0x7f5d700d2f00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 -- 172.21.15.43:0/3988503070 >> 172.21.15.43:0/3988503070 conn(0x7f5d70067640 msgr2=0x7f5d700d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 -- 172.21.15.43:0/3988503070 shutdown_connections 2024-06-13T11:37:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.514+0000 7f5d77e76640 1 -- 172.21.15.43:0/3988503070 wait complete. 2024-06-13T11:37:44.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.515+0000 7f5d77e76640 1 Processor -- start 2024-06-13T11:37:44.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.515+0000 7f5d77e76640 1 -- start start 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d77e76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700abe00 0x7f5d701587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d77e76640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5d700d2a90 0x7f5d700b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d77e76640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 0x7f5d7014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d77e76640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700aae30 con 0x7f5d70155420 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d77e76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700aab50 con 0x7f5d700abe00 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d77e76640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700ab110 con 0x7f5d700d2a90 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d76413640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 0x7f5d7014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d76413640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 0x7f5d7014e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57532/0 (socket says 172.21.15.43:57532) 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.516+0000 7f5d76413640 1 -- 172.21.15.43:0/2134581374 learned_addr learned my addr 172.21.15.43:0/2134581374 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d75c12640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700abe00 0x7f5d701587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d75411640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5d700d2a90 0x7f5d700b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d76413640 1 -- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5d700d2a90 msgr2=0x7f5d700b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d76413640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5d700d2a90 0x7f5d700b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d76413640 1 -- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700abe00 msgr2=0x7f5d701587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d76413640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700abe00 0x7f5d701587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d76413640 1 -- 172.21.15.43:0/2134581374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d70157700 con 0x7f5d70155420 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d76413640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 0x7f5d7014e350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c7a0 tx=0x7f5d6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68003b70 con 0x7f5d70155420 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68003d30 con 0x7f5d70155420 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d701579e0 con 0x7f5d70155420 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800aa90 con 0x7f5d70155420 2024-06-13T11:37:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.517+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d70157fa0 con 0x7f5d70155420 2024-06-13T11:37:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.518+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7004ffb0 con 0x7f5d70155420 2024-06-13T11:37:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.519+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d6800ac30 con 0x7f5d70155420 2024-06-13T11:37:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.519+0000 7f5d627fc640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5d5406be30 0x7f5d5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.519+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d6808b0a0 con 0x7f5d70155420 2024-06-13T11:37:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.519+0000 7f5d75c12640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5d5406be30 0x7f5d5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.520+0000 7f5d75c12640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5d5406be30 0x7f5d5406e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0011e0 tx=0x7f5d6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.523+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5d68059720 con 0x7f5d70155420 2024-06-13T11:37:44.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.723+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d700ab920 con 0x7f5d70155420 2024-06-13T11:37:44.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.724+0000 7f5d627fc640 1 -- 172.21.15.43:0/2134581374 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f5d68059020 con 0x7f5d70155420 2024-06-13T11:37:44.724 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:44.725 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:12.203514+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:04.976802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:06.140645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:37:09.841737+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:44.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5d5406be30 msgr2=0x7f5d5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5d5406be30 0x7f5d5406e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0011e0 tx=0x7f5d6c009040 comp rx=0 tx=0).stop 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 msgr2=0x7f5d7014e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 0x7f5d7014e350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c7a0 tx=0x7f5d6800cc60 comp rx=0 tx=0).stop 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 shutdown_connections 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f5d5406be30 0x7f5d5406e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d70155420 0x7f5d7014e350 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f5d700d2a90 0x7f5d700b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 --2- 172.21.15.43:0/2134581374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d700abe00 0x7f5d701587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 >> 172.21.15.43:0/2134581374 conn(0x7f5d70067640 msgr2=0x7f5d70152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 shutdown_connections 2024-06-13T11:37:44.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.726+0000 7f5d77e76640 1 -- 172.21.15.43:0/2134581374 wait complete. 2024-06-13T11:37:44.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-13T11:37:44.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.842+0000 7fe792914640 1 Processor -- start 2024-06-13T11:37:44.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.842+0000 7fe792914640 1 -- start start 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe792914640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe78c155010 0x7fe78c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe792914640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c06d840 0x7fe78c071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe792914640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c0711f0 con 0x7fe78c0721d0 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe792914640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c072f60 con 0x7fe78c155010 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe792914640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c071490 con 0x7fe78c06d840 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe78bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe78c155010 0x7fe78c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe790eb1640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe78c0721d0 0x7fe78c06e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43084/0 (socket says 172.21.15.43:43084) 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe78bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe78c155010 0x7fe78c15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57540/0 (socket says 172.21.15.43:57540) 2024-06-13T11:37:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe790eb1640 1 -- 172.21.15.43:0/1730266227 learned_addr learned my addr 172.21.15.43:0/1730266227 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe78b7fe640 1 --2- 172.21.15.43:0/1730266227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c06d840 0x7fe78c071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe78bfff640 1 -- 172.21.15.43:0/1730266227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c06d840 msgr2=0x7fe78c071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe78bfff640 1 --2- 172.21.15.43:0/1730266227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c06d840 0x7fe78c071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.843+0000 7fe78bfff640 1 -- 172.21.15.43:0/1730266227 >> v1:172.21.15.43:6789/0 conn(0x7fe78c0721d0 legacy=0x7fe78c06e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.844+0000 7fe78bfff640 1 -- 172.21.15.43:0/1730266227 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c071770 con 0x7fe78c155010 2024-06-13T11:37:44.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.844+0000 7fe78bfff640 1 --2- 172.21.15.43:0/1730266227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c155010 0x7fe78c15f230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0097a0 tx=0x7fe77c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498e8b2db46dd5b3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.844+0000 7fe78affd640 1 -- 172.21.15.43:0/1730266227 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c037070 con 0x7fe78c155010 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.844+0000 7fe78affd640 1 -- 172.21.15.43:0/1730266227 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c032440 con 0x7fe78c155010 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.844+0000 7fe78affd640 1 -- 172.21.15.43:0/1730266227 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c032810 con 0x7fe78c155010 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 -- 172.21.15.43:0/1730266227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c155010 msgr2=0x7fe78c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 --2- 172.21.15.43:0/1730266227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c155010 0x7fe78c15f230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0097a0 tx=0x7fe77c02a180 comp rx=0 tx=0).stop 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 -- 172.21.15.43:0/1730266227 shutdown_connections 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 --2- 172.21.15.43:0/1730266227 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c06d840 0x7fe78c071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 --2- 172.21.15.43:0/1730266227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c155010 0x7fe78c15f230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 -- 172.21.15.43:0/1730266227 >> 172.21.15.43:0/1730266227 conn(0x7fe78c0b21f0 msgr2=0x7fe78c0b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 -- 172.21.15.43:0/1730266227 shutdown_connections 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.845+0000 7fe792914640 1 -- 172.21.15.43:0/1730266227 wait complete. 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.846+0000 7fe792914640 1 Processor -- start 2024-06-13T11:37:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.846+0000 7fe792914640 1 -- start start 2024-06-13T11:37:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe792914640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe78c06d840 0x7fe78c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe792914640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c155010 0x7fe78c145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe792914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 0x7fe78c146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe792914640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c06e960 con 0x7fe78c150480 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe792914640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c072c10 con 0x7fe78c06d840 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe792914640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c06eae0 con 0x7fe78c155010 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe790eb1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 0x7fe78c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe790eb1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 0x7fe78c146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57548/0 (socket says 172.21.15.43:57548) 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.847+0000 7fe790eb1640 1 -- 172.21.15.43:0/911196343 learned_addr learned my addr 172.21.15.43:0/911196343 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe78b7fe640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c155010 0x7fe78c145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe78bfff640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe78c06d840 0x7fe78c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe790eb1640 1 -- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c155010 msgr2=0x7fe78c145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe790eb1640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c155010 0x7fe78c145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe790eb1640 1 -- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe78c06d840 msgr2=0x7fe78c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe790eb1640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe78c06d840 0x7fe78c152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe790eb1640 1 -- 172.21.15.43:0/911196343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c160710 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe790eb1640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 0x7fe78c146430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe78400caf0 tx=0x7fe78400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784017070 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78400aca0 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c1609f0 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784012600 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.848+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c160fb0 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.849+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78c04ffb0 con 0x7fe78c150480 2024-06-13T11:37:44.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.850+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe78401a070 con 0x7fe78c150480 2024-06-13T11:37:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.850+0000 7fe788ff9640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe77806be30 0x7fe77806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.850+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe78408ae20 con 0x7fe78c150480 2024-06-13T11:37:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.850+0000 7fe78bfff640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe77806be30 0x7fe77806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.851+0000 7fe78bfff640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe77806be30 0x7fe77806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe77c034000 tx=0x7fe77c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:44.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:44.854+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe784058e40 con 0x7fe78c150480 2024-06-13T11:37:45.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.079+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe78c0b2670 con 0x7fe78c150480 2024-06-13T11:37:45.080 INFO:tasks.ceph.mon.a.smithi043.stderr:2024-06-13T11:37:45.080+0000 7f34c9d24640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T11:37:45.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.082+0000 7fe788ff9640 1 -- 172.21.15.43:0/911196343 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fe78405d140 con 0x7fe78c150480 2024-06-13T11:37:45.081 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe77806be30 msgr2=0x7fe77806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe77806be30 0x7fe77806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe77c034000 tx=0x7fe77c02e000 comp rx=0 tx=0).stop 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 msgr2=0x7fe78c146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 0x7fe78c146430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe78400caf0 tx=0x7fe78400a060 comp rx=0 tx=0).stop 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 shutdown_connections 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe77806be30 0x7fe77806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe78c150480 0x7fe78c146430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe78c155010 0x7fe78c145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 --2- 172.21.15.43:0/911196343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe78c06d840 0x7fe78c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 >> 172.21.15.43:0/911196343 conn(0x7fe78c0b21f0 msgr2=0x7fe78c0b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 shutdown_connections 2024-06-13T11:37:45.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.084+0000 7fe792914640 1 -- 172.21.15.43:0/911196343 wait complete. 2024-06-13T11:37:45.088 INFO:tasks.ceph.mds.b.smithi053.stderr: -4055> 2024-06-13T11:37:13.623+0000 7f81d4a51640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-13T11:37:45.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-13T11:37:45.120 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2024-06-13T11:37:45.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.202+0000 7f4aa70e7640 1 Processor -- start 2024-06-13T11:37:45.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.203+0000 7f4aa70e7640 1 -- start start 2024-06-13T11:37:45.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.203+0000 7f4aa70e7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa00af920 0x7f4aa0162c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:45.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.203+0000 7f4aa70e7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa01481b0 con 0x7f4aa015eb20 2024-06-13T11:37:45.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.203+0000 7f4aa70e7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa015f770 con 0x7f4aa0147dd0 2024-06-13T11:37:45.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.203+0000 7f4aa70e7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa00d0900 con 0x7f4aa00af920 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4aa5684640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4aa015eb20 0x7f4aa015efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43094/0 (socket says 172.21.15.43:43094) 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4aa5684640 1 -- 172.21.15.43:0/4108609968 learned_addr learned my addr 172.21.15.43:0/4108609968 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9ffff640 1 --2- 172.21.15.43:0/4108609968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa00af920 0x7f4aa0162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118618281 0 0) 0x7f4aa01481b0 con 0x7f4aa015eb20 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a88003520 con 0x7f4aa015eb20 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167807342 0 0) 0x7f4aa015f770 con 0x7f4aa0147dd0 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aa01481b0 con 0x7f4aa0147dd0 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3668683132 0 0) 0x7f4a88003520 con 0x7f4aa015eb20 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9ffff640 1 -- 172.21.15.43:0/4108609968 >> v1:172.21.15.53:6789/0 conn(0x7f4aa0147dd0 legacy=0x7f4aa00af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9ffff640 1 -- 172.21.15.43:0/4108609968 >> v1:172.21.15.43:6789/0 conn(0x7f4aa015eb20 legacy=0x7f4aa015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.204+0000 7f4a9ffff640 1 -- 172.21.15.43:0/4108609968 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa015fa50 con 0x7f4aa00af920 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.205+0000 7f4a9ffff640 1 --2- 172.21.15.43:0/4108609968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa00af920 0x7f4aa0162c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a940097d0 tx=0x7f4a9402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa3e4123117df6d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.205+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94037070 con 0x7f4aa00af920 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.205+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9402ab90 con 0x7f4aa00af920 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.205+0000 7f4a9f7fe640 1 -- 172.21.15.43:0/4108609968 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90001670 con 0x7f4aa00af920 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 -- 172.21.15.43:0/4108609968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa00af920 msgr2=0x7f4aa0162c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/4108609968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa00af920 0x7f4aa0162c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a940097d0 tx=0x7f4a9402a100 comp rx=0 tx=0).stop 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 -- 172.21.15.43:0/4108609968 shutdown_connections 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/4108609968 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa00af920 0x7f4aa0162c90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 -- 172.21.15.43:0/4108609968 >> 172.21.15.43:0/4108609968 conn(0x7f4aa0071960 msgr2=0x7f4aa0071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 -- 172.21.15.43:0/4108609968 shutdown_connections 2024-06-13T11:37:45.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.206+0000 7f4aa70e7640 1 -- 172.21.15.43:0/4108609968 wait complete. 2024-06-13T11:37:45.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.207+0000 7f4aa70e7640 1 Processor -- start 2024-06-13T11:37:45.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.207+0000 7f4aa70e7640 1 -- start start 2024-06-13T11:37:45.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa70e7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 0x7f4aa0160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:45.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa70e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0147dd0 0x7f4aa0157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa70e7640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa015eb20 0x7f4aa01f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa70e7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0162490 con 0x7f4aa00af920 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa70e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0162800 con 0x7f4aa0147dd0 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa70e7640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa00b0390 con 0x7f4aa015eb20 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 0x7f4aa0160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 0x7f4aa0160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57562/0 (socket says 172.21.15.43:57562) 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 -- 172.21.15.43:0/2958264368 learned_addr learned my addr 172.21.15.43:0/2958264368 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa5684640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa015eb20 0x7f4aa01f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4a9ffff640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0147dd0 0x7f4aa0157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 -- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa015eb20 msgr2=0x7f4aa01f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa015eb20 0x7f4aa01f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 -- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0147dd0 msgr2=0x7f4aa0157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0147dd0 0x7f4aa0157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 -- 172.21.15.43:0/2958264368 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa0160ba0 con 0x7f4aa00af920 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.208+0000 7f4aa4e83640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 0x7f4aa0160510 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c800 tx=0x7f4a9800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.209+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98003b70 con 0x7f4aa00af920 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.209+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98003d10 con 0x7f4aa00af920 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.209+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa0160e80 con 0x7f4aa00af920 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.209+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800aa90 con 0x7f4aa00af920 2024-06-13T11:37:45.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.209+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa0145b70 con 0x7f4aa00af920 2024-06-13T11:37:45.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.210+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa00688c0 con 0x7f4aa00af920 2024-06-13T11:37:45.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.210+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a9800ac30 con 0x7f4aa00af920 2024-06-13T11:37:45.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.211+0000 7f4a9d7fa640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8c06be30 0x7f4a8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:45.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.211+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6618+0+0 (secure 0 0 0) 0x7f4a9808b090 con 0x7f4aa00af920 2024-06-13T11:37:45.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.211+0000 7f4a9ffff640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8c06be30 0x7f4a8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:45.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.211+0000 7f4a9ffff640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8c06be30 0x7f4a8c06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a94034000 tx=0x7f4a9402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:45.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.215+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4a980590f0 con 0x7f4aa00af920 2024-06-13T11:37:45.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:45.441+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4aa004ffb0 con 0x7f4aa00af920 2024-06-13T11:37:46.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.086+0000 7f4a9d7fa640 1 -- 172.21.15.43:0/2958264368 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f4a9805d3f0 con 0x7f4aa00af920 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8c06be30 msgr2=0x7f4a8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8c06be30 0x7f4a8c06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a94034000 tx=0x7f4a9402e000 comp rx=0 tx=0).stop 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 msgr2=0x7f4aa0160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 0x7f4aa0160510 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c800 tx=0x7f4a9800ccc0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 shutdown_connections 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4a8c06be30 0x7f4a8c06e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4aa015eb20 0x7f4aa01f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0147dd0 0x7f4aa0157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 --2- 172.21.15.43:0/2958264368 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa00af920 0x7f4aa0160510 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 >> 172.21.15.43:0/2958264368 conn(0x7f4aa0071960 msgr2=0x7f4aa01425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 shutdown_connections 2024-06-13T11:37:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.088+0000 7f4aa70e7640 1 -- 172.21.15.43:0/2958264368 wait complete. 2024-06-13T11:37:46.102 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-13T11:37:46.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.216+0000 7f820275a640 1 Processor -- start 2024-06-13T11:37:46.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.216+0000 7f820275a640 1 -- start start 2024-06-13T11:37:46.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f820275a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f81fc0aedd0 0x7f81fc071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f820275a640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f820275a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81fc1406d0 0x7f81fc140b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f820275a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc0af1b0 con 0x7f81fc0aedd0 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f820275a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc070990 con 0x7f81fc1406d0 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f820275a640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc141400 con 0x7f81fc06e7f0 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f81fc0aedd0 0x7f81fc071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f81fc0aedd0 0x7f81fc071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57574/0 (socket says 172.21.15.43:57574) 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 -- 172.21.15.43:0/2905226184 learned_addr learned my addr 172.21.15.43:0/2905226184 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 -- 172.21.15.43:0/2905226184 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 msgr2=0x7f81fc06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 --2- 172.21.15.43:0/2905226184 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 -- 172.21.15.43:0/2905226184 >> v2:172.21.15.53:3300/0 conn(0x7f81fc1406d0 msgr2=0x7f81fc140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 --2- 172.21.15.43:0/2905226184 >> v2:172.21.15.53:3300/0 conn(0x7f81fc1406d0 0x7f81fc140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.217+0000 7f81fbfff640 1 -- 172.21.15.43:0/2905226184 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc070c50 con 0x7f81fc0aedd0 2024-06-13T11:37:46.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.218+0000 7f81fbfff640 1 --2- 172.21.15.43:0/2905226184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc0aedd0 0x7f81fc071450 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81fc15eb20 tx=0x7f81ec02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8b8a0f7bfea79f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.218+0000 7f81faffd640 1 -- 172.21.15.43:0/2905226184 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec032790 con 0x7f81fc0aedd0 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.218+0000 7f81faffd640 1 -- 172.21.15.43:0/2905226184 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec038070 con 0x7f81fc0aedd0 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.218+0000 7f81faffd640 1 -- 172.21.15.43:0/2905226184 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec032b50 con 0x7f81fc0aedd0 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 -- 172.21.15.43:0/2905226184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc0aedd0 msgr2=0x7f81fc071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 --2- 172.21.15.43:0/2905226184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc0aedd0 0x7f81fc071450 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81fc15eb20 tx=0x7f81ec02c890 comp rx=0 tx=0).stop 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 -- 172.21.15.43:0/2905226184 shutdown_connections 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 --2- 172.21.15.43:0/2905226184 >> v2:172.21.15.53:3300/0 conn(0x7f81fc1406d0 0x7f81fc140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 --2- 172.21.15.43:0/2905226184 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 --2- 172.21.15.43:0/2905226184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc0aedd0 0x7f81fc071450 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 -- 172.21.15.43:0/2905226184 >> 172.21.15.43:0/2905226184 conn(0x7f81fc067940 msgr2=0x7f81fc0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 -- 172.21.15.43:0/2905226184 shutdown_connections 2024-06-13T11:37:46.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.219+0000 7f820275a640 1 -- 172.21.15.43:0/2905226184 wait complete. 2024-06-13T11:37:46.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.220+0000 7f820275a640 1 Processor -- start 2024-06-13T11:37:46.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.220+0000 7f820275a640 1 -- start start 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f820275a640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc1f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f820275a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81fc0aedd0 0x7f81fc138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f820275a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 0x7f81fc0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f820275a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc0ccd00 con 0x7f81fc1406d0 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f820275a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1410a0 con 0x7f81fc0aedd0 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f820275a640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc0cce80 con 0x7f81fc06e7f0 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 0x7f81fc0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 0x7f81fc0ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57590/0 (socket says 172.21.15.43:57590) 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 -- 172.21.15.43:0/2742626430 learned_addr learned my addr 172.21.15.43:0/2742626430 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f81fbfff640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc1f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f81fb7fe640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81fc0aedd0 0x7f81fc138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:46.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 -- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 msgr2=0x7f81fc1f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc1f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 -- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81fc0aedd0 msgr2=0x7f81fc138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81fc0aedd0 0x7f81fc138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.221+0000 7f8200cf7640 1 -- 172.21.15.43:0/2742626430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc138cf0 con 0x7f81fc1406d0 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.222+0000 7f8200cf7640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 0x7f81fc0ad8a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81f400b970 tx=0x7f81f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.222+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4019070 con 0x7f81fc1406d0 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.222+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f400cb60 con 0x7f81fc1406d0 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.222+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc138fd0 con 0x7f81fc1406d0 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.222+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4014440 con 0x7f81fc1406d0 2024-06-13T11:37:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.222+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc139870 con 0x7f81fc1406d0 2024-06-13T11:37:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.223+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc1391a0 con 0x7f81fc1406d0 2024-06-13T11:37:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.223+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81f401c070 con 0x7f81fc1406d0 2024-06-13T11:37:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.224+0000 7f81f8ff9640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f81e806be30 0x7f81e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.224+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6618+0+0 (secure 0 0 0) 0x7f81f408aed0 con 0x7f81fc1406d0 2024-06-13T11:37:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.224+0000 7f81fbfff640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f81e806be30 0x7f81e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.225+0000 7f81fbfff640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f81e806be30 0x7f81e806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f81ec037000 tx=0x7f81ec032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:46.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.229+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f81f4059580 con 0x7f81fc1406d0 2024-06-13T11:37:46.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:46.413+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81fc04ffb0 con 0x7f81fc1406d0 2024-06-13T11:37:47.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.087+0000 7f81f8ff9640 1 -- 172.21.15.43:0/2742626430 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f81f4058e80 con 0x7f81fc1406d0 2024-06-13T11:37:47.088 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-06-13T11:37:47.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f81e806be30 msgr2=0x7f81e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f81e806be30 0x7f81e806e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f81ec037000 tx=0x7f81ec032000 comp rx=0 tx=0).stop 2024-06-13T11:37:47.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 msgr2=0x7f81fc0ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 0x7f81fc0ad8a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81f400b970 tx=0x7f81f400be30 comp rx=0 tx=0).stop 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 shutdown_connections 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f81e806be30 0x7f81e806e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81fc1406d0 0x7f81fc0ad8a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81fc0aedd0 0x7f81fc138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 --2- 172.21.15.43:0/2742626430 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f81fc06e7f0 0x7f81fc1f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 >> 172.21.15.43:0/2742626430 conn(0x7f81fc067940 msgr2=0x7f81fc15cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 shutdown_connections 2024-06-13T11:37:47.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.091+0000 7f820275a640 1 -- 172.21.15.43:0/2742626430 wait complete. 2024-06-13T11:37:47.105 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-13T11:37:47.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.219+0000 7f36b4038640 1 Processor -- start 2024-06-13T11:37:47.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.219+0000 7f36b4038640 1 -- start start 2024-06-13T11:37:47.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.220+0000 7f36b4038640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36ac0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.220+0000 7f36b4038640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ac15b090 con 0x7f36ac140c40 2024-06-13T11:37:47.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.220+0000 7f36b4038640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ac0cfd00 con 0x7f36ac0ceff0 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.220+0000 7f36b4038640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0cffe0 con 0x7f36ac0cce90 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.220+0000 7f36b1dd4640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f36ac140c40 0x7f36ac06d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43096/0 (socket says 172.21.15.43:43096) 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.220+0000 7f36b1dd4640 1 -- 172.21.15.43:0/799498094 learned_addr learned my addr 172.21.15.43:0/799498094 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649959908 0 0) 0x7f36a8001110 con 0x7f36ac140c40 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3698003520 con 0x7f36ac140c40 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36ac0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1843268606 0 0) 0x7f3698003520 con 0x7f36ac140c40 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 msgr2=0x7f36ac0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36ac0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 >> v1:172.21.15.53:6789/0 conn(0x7f36ac0ceff0 legacy=0x7f36ac0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac0718f0 con 0x7f36ac140c40 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f36a8001840 con 0x7f36ac140c40 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36ac0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:47.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 >> v1:172.21.15.43:6789/0 conn(0x7f36ac140c40 legacy=0x7f36ac06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f3698004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3698004d40 0x7f36980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0cffe0 con 0x7f3698003fd0 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f369800ccc0 con 0x7f3698004d40 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f369800cec0 con 0x7f36ac0cce90 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f3698004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b1dd4640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b25d5640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3698004d40 0x7f36980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 -- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 msgr2=0x7f36980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac0cce90 0x7f36980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 -- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3698004d40 msgr2=0x7f36980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3698004d40 0x7f36980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.221+0000 7f36b15d3640 1 -- 172.21.15.43:0/799498094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3698003520 con 0x7f3698003fd0 2024-06-13T11:37:47.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.222+0000 7f36b15d3640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f3698004800 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098a0 tx=0x7f3698005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ab1b81408c4c68 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:47.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.222+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c00f040 con 0x7f3698003fd0 2024-06-13T11:37:47.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.222+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c004030 con 0x7f3698003fd0 2024-06-13T11:37:47.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.222+0000 7f36b0dd2640 1 -- 172.21.15.43:0/799498094 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c004400 con 0x7f3698003fd0 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b4038640 1 -- 172.21.15.43:0/799498094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 msgr2=0x7f3698004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b4038640 1 --2- 172.21.15.43:0/799498094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f3698004800 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f369c0098a0 tx=0x7f3698005830 comp rx=0 tx=0).stop 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b25d5640 1 -- 172.21.15.43:0/799498094 reap_dead start 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b4038640 1 -- 172.21.15.43:0/799498094 shutdown_connections 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b4038640 1 -- 172.21.15.43:0/799498094 >> 172.21.15.43:0/799498094 conn(0x7f36ac067940 msgr2=0x7f36ac0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b4038640 1 -- 172.21.15.43:0/799498094 shutdown_connections 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.223+0000 7f36b4038640 1 -- 172.21.15.43:0/799498094 wait complete. 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.224+0000 7f36b4038640 1 Processor -- start 2024-06-13T11:37:47.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.224+0000 7f36b4038640 1 -- start start 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b4038640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f36ac135610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b4038640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ac137000 0x7f36ac1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b4038640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac156fa0 0x7f36ac159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b4038640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0cd340 con 0x7f3698003fd0 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b4038640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac141020 con 0x7f36ac137000 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b4038640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0cd4c0 con 0x7f36ac156fa0 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f36ac135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f36ac135610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57612/0 (socket says 172.21.15.43:57612) 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 -- 172.21.15.43:0/3846444527 learned_addr learned my addr 172.21.15.43:0/3846444527 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 -- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac156fa0 msgr2=0x7f36ac159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac156fa0 0x7f36ac159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 -- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ac137000 msgr2=0x7f36ac1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ac137000 0x7f36ac1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:47.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.225+0000 7f36b1dd4640 1 -- 172.21.15.43:0/3846444527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac135f60 con 0x7f3698003fd0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.226+0000 7f36b1dd4640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f36ac135610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36a8007300 tx=0x7f36a80077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.226+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8015070 con 0x7f3698003fd0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.226+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a800fc70 con 0x7f3698003fd0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.226+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac136240 con 0x7f3698003fd0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.226+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011440 con 0x7f3698003fd0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.226+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac136800 con 0x7f3698003fd0 2024-06-13T11:37:47.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.227+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac04ffb0 con 0x7f3698003fd0 2024-06-13T11:37:47.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.227+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36a8018070 con 0x7f3698003fd0 2024-06-13T11:37:47.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.228+0000 7f36a27fc640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f369006be60 0x7f369006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:47.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.228+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6180+0+0 (secure 0 0 0) 0x7f36a808b350 con 0x7f3698003fd0 2024-06-13T11:37:47.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.228+0000 7f36b15d3640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f369006be60 0x7f369006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:47.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.228+0000 7f36b15d3640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f369006be60 0x7f369006e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f369c03c000 tx=0x7f369c037000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:47.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.232+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f36ac15b090 con 0x7f3698003fd0 2024-06-13T11:37:47.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:47.422+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f36ac0b2f20 con 0x7f3698003fd0 2024-06-13T11:37:48.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.092+0000 7f36a27fc640 1 -- 172.21.15.43:0/3846444527 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f36a80599f0 con 0x7f3698003fd0 2024-06-13T11:37:48.092 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-06-13T11:37:48.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.096+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f369006be60 msgr2=0x7f369006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.096+0000 7f36b4038640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f369006be60 0x7f369006e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f369c03c000 tx=0x7f369c037000 comp rx=0 tx=0).stop 2024-06-13T11:37:48.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.096+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 msgr2=0x7f36ac135610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.096+0000 7f36b4038640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f36ac135610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36a8007300 tx=0x7f36a80077c0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 shutdown_connections 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f369006be60 0x7f369006e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f36ac156fa0 0x7f36ac159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ac137000 0x7f36ac1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 --2- 172.21.15.43:0/3846444527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3698003fd0 0x7f36ac135610 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 >> 172.21.15.43:0/3846444527 conn(0x7f36ac067940 msgr2=0x7f36ac15e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.097+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 shutdown_connections 2024-06-13T11:37:48.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.098+0000 7f36b4038640 1 -- 172.21.15.43:0/3846444527 wait complete. 2024-06-13T11:37:48.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-13T11:37:48.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.229+0000 7f9148eda640 1 Processor -- start 2024-06-13T11:37:48.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.229+0000 7f9148eda640 1 -- start start 2024-06-13T11:37:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.230+0000 7f9148eda640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f914413eff0 0x7f914413f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.230+0000 7f9148eda640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914415fba0 con 0x7f9144070d30 2024-06-13T11:37:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.230+0000 7f9148eda640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914415fe80 con 0x7f914406c760 2024-06-13T11:37:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.230+0000 7f9148eda640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9144160160 con 0x7f914413eff0 2024-06-13T11:37:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.230+0000 7f9141d9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9144070d30 0x7f914406c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43100/0 (socket says 172.21.15.43:43100) 2024-06-13T11:37:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.230+0000 7f9141d9b640 1 -- 172.21.15.43:0/2319649322 learned_addr learned my addr 172.21.15.43:0/2319649322 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914259c640 1 --2- 172.21.15.43:0/2319649322 >> v2:172.21.15.53:3300/0 conn(0x7f914413eff0 0x7f914413f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923412804 0 0) 0x7f914415fba0 con 0x7f9144070d30 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9130003520 con 0x7f9144070d30 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092635086 0 0) 0x7f9130003520 con 0x7f9144070d30 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 >> v2:172.21.15.53:3300/0 conn(0x7f914413eff0 msgr2=0x7f914413f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 --2- 172.21.15.43:0/2319649322 >> v2:172.21.15.53:3300/0 conn(0x7f914413eff0 0x7f914413f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 >> v1:172.21.15.53:6789/0 conn(0x7f914406c760 legacy=0x7f9144141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9144160440 con 0x7f9144070d30 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f912c001670 con 0x7f9144070d30 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 >> v1:172.21.15.43:6789/0 conn(0x7f9144070d30 legacy=0x7f914406c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91300039b0 0x7f9130003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91300043b0 0x7f9130004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9130005120 0x7f913000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9144160160 con 0x7f9130005120 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f913000c060 con 0x7f91300039b0 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f913000c260 con 0x7f91300043b0 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9142d9d640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9130005120 0x7f913000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f914259c640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91300039b0 0x7f9130003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9141d9b640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91300043b0 0x7f9130004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9142d9d640 1 -- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91300043b0 msgr2=0x7f9130004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9142d9d640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f91300043b0 0x7f9130004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9142d9d640 1 -- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91300039b0 msgr2=0x7f9130003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9142d9d640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91300039b0 0x7f9130003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.231+0000 7f9142d9d640 1 -- 172.21.15.43:0/2319649322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9130003520 con 0x7f9130005120 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.232+0000 7f9142d9d640 1 -- 172.21.15.43:0/2319649322 reap_dead start 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.232+0000 7f9142d9d640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9130005120 0x7f913000b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f913c001860 tx=0x7f9130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcc93376c78a6d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.232+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c001430 con 0x7f9130005120 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.232+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c005330 con 0x7f9130005120 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.232+0000 7f914159a640 1 -- 172.21.15.43:0/2319649322 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c02ac10 con 0x7f9130005120 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 -- 172.21.15.43:0/2319649322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9130005120 msgr2=0x7f913000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9130005120 0x7f913000b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f913c001860 tx=0x7f9130005830 comp rx=0 tx=0).stop 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 -- 172.21.15.43:0/2319649322 shutdown_connections 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 --2- 172.21.15.43:0/2319649322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9130005120 0x7f913000b9c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 -- 172.21.15.43:0/2319649322 >> 172.21.15.43:0/2319649322 conn(0x7f91440b2650 msgr2=0x7f91440b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 -- 172.21.15.43:0/2319649322 shutdown_connections 2024-06-13T11:37:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.233+0000 7f9148eda640 1 -- 172.21.15.43:0/2319649322 wait complete. 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.234+0000 7f9148eda640 1 Processor -- start 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.234+0000 7f9148eda640 1 -- start start 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9148eda640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9130005120 0x7f9144159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9148eda640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 0x7f914413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9148eda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f914415e700 0x7f914415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9148eda640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91440a9650 con 0x7f914413bd90 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9148eda640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f914413f3d0 con 0x7f914415e700 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9148eda640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f91440a97d0 con 0x7f9130005120 2024-06-13T11:37:48.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9141d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 0x7f914413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9141d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 0x7f914413c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57632/0 (socket says 172.21.15.43:57632) 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9141d9b640 1 -- 172.21.15.43:0/4218837082 learned_addr learned my addr 172.21.15.43:0/4218837082 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f914259c640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9130005120 0x7f9144159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.235+0000 7f9142d9d640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f914415e700 0x7f914415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9141d9b640 1 -- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9130005120 msgr2=0x7f9144159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9141d9b640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9130005120 0x7f9144159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9141d9b640 1 -- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f914415e700 msgr2=0x7f914415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9141d9b640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f914415e700 0x7f914415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9141d9b640 1 -- 172.21.15.43:0/4218837082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914413c8c0 con 0x7f914413bd90 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9142d9d640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f914415e700 0x7f914415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f914259c640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9130005120 0x7f9144159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9141d9b640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 0x7f914413c210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e760 tx=0x7f912c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c00c6c0 con 0x7f914413bd90 2024-06-13T11:37:48.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c018070 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91440af190 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ca80 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.236+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91440af750 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.237+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914415f0c0 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.238+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f912c00cc20 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.238+0000 7f913affd640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f912406be30 0x7f912406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.238+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5766+0+0 (secure 0 0 0) 0x7f912c08abf0 con 0x7f914413bd90 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.238+0000 7f914259c640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f912406be30 0x7f912406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:48.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.239+0000 7f914259c640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f912406be30 0x7f912406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9134007520 tx=0x7f913400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:48.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.242+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f912c0595f0 con 0x7f914413bd90 2024-06-13T11:37:48.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:48.427+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f914404ffb0 con 0x7f914413bd90 2024-06-13T11:37:49.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.096+0000 7f913affd640 1 -- 172.21.15.43:0/4218837082 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v29) ==== 178+0+0 (secure 0 0 0) 0x7f912c058ef0 con 0x7f914413bd90 2024-06-13T11:37:49.097 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data_ec' removed 2024-06-13T11:37:49.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f912406be30 msgr2=0x7f912406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f912406be30 0x7f912406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9134007520 tx=0x7f913400b040 comp rx=0 tx=0).stop 2024-06-13T11:37:49.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 msgr2=0x7f914413c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 0x7f914413c210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e760 tx=0x7f912c00ec20 comp rx=0 tx=0).stop 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 shutdown_connections 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f912406be30 0x7f912406e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f914415e700 0x7f914415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f914413bd90 0x7f914413c210 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 --2- 172.21.15.43:0/4218837082 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9130005120 0x7f9144159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.104+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 >> 172.21.15.43:0/4218837082 conn(0x7f91440b2650 msgr2=0x7f914413f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.105+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 shutdown_connections 2024-06-13T11:37:49.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.105+0000 7f9148eda640 1 -- 172.21.15.43:0/4218837082 wait complete. 2024-06-13T11:37:49.120 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-13T11:37:49.120 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-13T11:37:49.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-13T11:37:49.120 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T11:37:49.120 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-13T11:37:49.120 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-13T11:37:49.121 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-13T11:37:49.121 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T11:37:49.121 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-13T11:37:49.121 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-13T11:37:49.121 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-13T11:37:49.121 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T11:37:49.121 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-13T11:37:49.122 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-13T11:37:49.122 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-13T11:37:49.122 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T11:37:49.131 INFO:tasks.ceph.mds.a:Stopped 2024-06-13T11:37:49.131 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-13T11:37:49.132 INFO:tasks.ceph.mds.c:Stopped 2024-06-13T11:37:49.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-13T11:37:49.133 INFO:tasks.ceph.mds.d:Stopped 2024-06-13T11:37:49.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-13T11:37:49.134 INFO:tasks.ceph.mds.b:Stopped 2024-06-13T11:37:49.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-13T11:37:49.173 INFO:tasks.ceph.mds.a:Started 2024-06-13T11:37:49.174 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:49.174 INFO:tasks.ceph.mds.c:Started 2024-06-13T11:37:49.175 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:49.177 INFO:tasks.ceph.mds.d:Started 2024-06-13T11:37:49.177 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:49.177 INFO:tasks.ceph.mds.b:Started 2024-06-13T11:37:49.178 DEBUG:teuthology.parallel:result is None 2024-06-13T11:37:49.178 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-13T11:37:49.259 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2024-06-13T11:37:49.259 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-06-13T11:37:49.267 INFO:tasks.ceph.mds.d.smithi053.stdout:starting mds.d at 2024-06-13T11:37:49.267 INFO:tasks.ceph.mds.b.smithi053.stdout:starting mds.b at 2024-06-13T11:37:49.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.293+0000 7f3e4e7b6640 1 Processor -- start 2024-06-13T11:37:49.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.293+0000 7f3e4e7b6640 1 -- start start 2024-06-13T11:37:49.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e4e7b6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480d1480 0x7f3e480cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:49.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e4e7b6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e48071c10 con 0x7f3e481480b0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e4e7b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e48071ef0 con 0x7f3e480cfba0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e4e7b6640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3e480721d0 con 0x7f3e480d1480 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e47fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3e481480b0 0x7f3e48072cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43122/0 (socket says 172.21.15.43:43122) 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e47fff640 1 -- 172.21.15.43:0/2707474445 learned_addr learned my addr 172.21.15.43:0/2707474445 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.294+0000 7f3e4cd53640 1 --2- 172.21.15.43:0/2707474445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480d1480 0x7f3e480cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973442489 0 0) 0x7f3e48071c10 con 0x7f3e481480b0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e30003520 con 0x7f3e481480b0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401440070 0 0) 0x7f3e48071ef0 con 0x7f3e480cfba0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e48071c10 con 0x7f3e480cfba0 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e4cd53640 1 -- 172.21.15.43:0/2707474445 >> v1:172.21.15.53:6789/0 conn(0x7f3e480cfba0 legacy=0x7f3e480d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e4cd53640 1 -- 172.21.15.43:0/2707474445 >> v1:172.21.15.43:6789/0 conn(0x7f3e481480b0 legacy=0x7f3e48072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.295+0000 7f3e4cd53640 1 -- 172.21.15.43:0/2707474445 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e480724b0 con 0x7f3e480d1480 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e4cd53640 1 --2- 172.21.15.43:0/2707474445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480d1480 0x7f3e480cffe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009dc0 tx=0x7f3e4002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8366fd4fb354fb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40007740 con 0x7f3e480d1480 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e400078e0 con 0x7f3e480d1480 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e46ffd640 1 -- 172.21.15.43:0/2707474445 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40007cb0 con 0x7f3e480d1480 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/2707474445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480d1480 msgr2=0x7f3e480cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/2707474445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480d1480 0x7f3e480cffe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009dc0 tx=0x7f3e4002a6d0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/2707474445 shutdown_connections 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/2707474445 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480d1480 0x7f3e480cffe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.296+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/2707474445 >> 172.21.15.43:0/2707474445 conn(0x7f3e48070810 msgr2=0x7f3e48070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.297+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/2707474445 shutdown_connections 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.297+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/2707474445 wait complete. 2024-06-13T11:37:49.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.298+0000 7f3e4e7b6640 1 Processor -- start 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.298+0000 7f3e4e7b6640 1 -- start start 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4e7b6640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480cfba0 0x7f3e4815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4e7b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 0x7f3e48140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4e7b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 0x7f3e481413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4e7b6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e480ae180 con 0x7f3e481480b0 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4e7b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3e480718c0 con 0x7f3e480d1480 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4e7b6640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f3e480ae300 con 0x7f3e480cfba0 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 0x7f3e481413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480cfba0 0x7f3e4815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 0x7f3e48140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 0x7f3e481413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57654/0 (socket says 172.21.15.43:57654) 2024-06-13T11:37:49.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 -- 172.21.15.43:0/3644978630 learned_addr learned my addr 172.21.15.43:0/3644978630 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e477fe640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 0x7f3e48140ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.43:40218/0 (socket says 172.21.15.43:40218) 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 -- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480cfba0 msgr2=0x7f3e4815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480cfba0 0x7f3e4815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 -- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 msgr2=0x7f3e48140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 0x7f3e48140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 -- 172.21.15.43:0/3644978630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e48141aa0 con 0x7f3e481480b0 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e47fff640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480cfba0 0x7f3e4815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e477fe640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 0x7f3e48140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.299+0000 7f3e4cd53640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 0x7f3e481413e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009ee0 tx=0x7f3e40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.300+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40040070 con 0x7f3e481480b0 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.300+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e40031bc0 con 0x7f3e481480b0 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.300+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e48141d80 con 0x7f3e481480b0 2024-06-13T11:37:49.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.300+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40009450 con 0x7f3e481480b0 2024-06-13T11:37:49.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.300+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4815fa90 con 0x7f3e481480b0 2024-06-13T11:37:49.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.301+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4804ffb0 con 0x7f3e481480b0 2024-06-13T11:37:49.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.301+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e40039040 con 0x7f3e481480b0 2024-06-13T11:37:49.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.302+0000 7f3e44ff9640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3e3406be30 0x7f3e3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:49.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.302+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5335+0+0 (secure 0 0 0) 0x7f3e400ac2d0 con 0x7f3e481480b0 2024-06-13T11:37:49.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.302+0000 7f3e47fff640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3e3406be30 0x7f3e3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:49.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.303+0000 7f3e47fff640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3e3406be30 0x7f3e3406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e38000f60 tx=0x7f3e38007d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:49.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.306+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3e4007a7a0 con 0x7f3e481480b0 2024-06-13T11:37:49.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:49.506+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3e48071620 con 0x7f3e481480b0 2024-06-13T11:37:50.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.105+0000 7f3e44ff9640 1 -- 172.21.15.43:0/3644978630 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) ==== 97+0+0 (secure 0 0 0) 0x7f3e4007eaa0 con 0x7f3e481480b0 2024-06-13T11:37:50.105 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2024-06-13T11:37:50.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3e3406be30 msgr2=0x7f3e3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3e3406be30 0x7f3e3406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e38000f60 tx=0x7f3e38007d70 comp rx=0 tx=0).stop 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 msgr2=0x7f3e481413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 0x7f3e481413e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009ee0 tx=0x7f3e40004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 shutdown_connections 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f3e3406be30 0x7f3e3406e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e481480b0 0x7f3e481413e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e480d1480 0x7f3e48140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 --2- 172.21.15.43:0/3644978630 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f3e480cfba0 0x7f3e4815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 >> 172.21.15.43:0/3644978630 conn(0x7f3e48070810 msgr2=0x7f3e480d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 shutdown_connections 2024-06-13T11:37:50.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.108+0000 7f3e4e7b6640 1 -- 172.21.15.43:0/3644978630 wait complete. 2024-06-13T11:37:50.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-13T11:37:50.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.227+0000 7f63a9612640 1 Processor -- start 2024-06-13T11:37:50.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.227+0000 7f63a9612640 1 -- start start 2024-06-13T11:37:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a9612640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a40721b0 0x7f63a4072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a9612640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63a415c290 0x7f63a415c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a9612640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a415cea0 con 0x7f63a4144c20 2024-06-13T11:37:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a9612640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f63a4145000 con 0x7f63a415c290 2024-06-13T11:37:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a9612640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f63a415cc40 con 0x7f63a40721b0 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a37fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63a415c290 0x7f63a415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a2ffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f63a4144c20 0x7f63a40cc960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43130/0 (socket says 172.21.15.43:43130) 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a2ffd640 1 -- 172.21.15.43:0/673096839 learned_addr learned my addr 172.21.15.43:0/673096839 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a37fe640 1 -- 172.21.15.43:0/673096839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a40721b0 msgr2=0x7f63a4072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a37fe640 1 --2- 172.21.15.43:0/673096839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a40721b0 0x7f63a4072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a37fe640 1 -- 172.21.15.43:0/673096839 >> v1:172.21.15.43:6789/0 conn(0x7f63a4144c20 legacy=0x7f63a40cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.228+0000 7f63a37fe640 1 -- 172.21.15.43:0/673096839 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a415d180 con 0x7f63a415c290 2024-06-13T11:37:50.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a37fe640 1 --2- 172.21.15.43:0/673096839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a415c700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f639c00bfa0 tx=0x7f639c02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9962aadd53f72568 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:50.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a1ffb640 1 -- 172.21.15.43:0/673096839 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c039070 con 0x7f63a415c290 2024-06-13T11:37:50.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a1ffb640 1 -- 172.21.15.43:0/673096839 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c009540 con 0x7f63a415c290 2024-06-13T11:37:50.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a1ffb640 1 -- 172.21.15.43:0/673096839 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c009910 con 0x7f63a415c290 2024-06-13T11:37:50.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 -- 172.21.15.43:0/673096839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 msgr2=0x7f63a415c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 --2- 172.21.15.43:0/673096839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a415c700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f639c00bfa0 tx=0x7f639c02c860 comp rx=0 tx=0).stop 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 -- 172.21.15.43:0/673096839 shutdown_connections 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 --2- 172.21.15.43:0/673096839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a415c700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 --2- 172.21.15.43:0/673096839 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a40721b0 0x7f63a4072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 -- 172.21.15.43:0/673096839 >> 172.21.15.43:0/673096839 conn(0x7f63a40b14b0 msgr2=0x7f63a40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.229+0000 7f63a9612640 1 -- 172.21.15.43:0/673096839 shutdown_connections 2024-06-13T11:37:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.230+0000 7f63a9612640 1 -- 172.21.15.43:0/673096839 wait complete. 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.231+0000 7f63a9612640 1 Processor -- start 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.231+0000 7f63a9612640 1 -- start start 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a9612640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a40721b0 0x7f63a415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a9612640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a4144c20 0x7f63a412e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a9612640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a41e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a9612640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63a415da20 con 0x7f63a415c290 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a9612640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f63a415d740 con 0x7f63a40721b0 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a9612640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f63a415df40 con 0x7f63a4144c20 2024-06-13T11:37:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a41e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a41e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57664/0 (socket says 172.21.15.43:57664) 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 -- 172.21.15.43:0/1217566488 learned_addr learned my addr 172.21.15.43:0/1217566488 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a2ffd640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a40721b0 0x7f63a415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a27fc640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a4144c20 0x7f63a412e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 -- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a4144c20 msgr2=0x7f63a412e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a4144c20 0x7f63a412e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 -- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a40721b0 msgr2=0x7f63a415acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a40721b0 0x7f63a415acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 -- 172.21.15.43:0/1217566488 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a412edc0 con 0x7f63a415c290 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f63a37fe640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a41e5a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f639c00bfa0 tx=0x7f639c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c039050 con 0x7f63a415c290 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c03a040 con 0x7f63a415c290 2024-06-13T11:37:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.232+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c034880 con 0x7f63a415c290 2024-06-13T11:37:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.233+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a412f0a0 con 0x7f63a415c290 2024-06-13T11:37:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.233+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a413faf0 con 0x7f63a415c290 2024-06-13T11:37:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.234+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a404ffb0 con 0x7f63a415c290 2024-06-13T11:37:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.234+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f639c047020 con 0x7f63a415c290 2024-06-13T11:37:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.235+0000 7f638b7fe640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f639006be30 0x7f639006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.235+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f639c0ad350 con 0x7f63a415c290 2024-06-13T11:37:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.235+0000 7f63a2ffd640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f639006be30 0x7f639006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.235+0000 7f63a2ffd640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f639006be30 0x7f639006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6394000f60 tx=0x7f6394009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.239+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f639c04e020 con 0x7f63a415c290 2024-06-13T11:37:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.493+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f63a4073330 con 0x7f63a415c290 2024-06-13T11:37:50.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.494+0000 7f638b7fe640 1 -- 172.21.15.43:0/1217566488 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f639c07bf80 con 0x7f63a415c290 2024-06-13T11:37:50.494 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:50.494 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-06-13T11:37:50.494 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2024-06-13T11:37:50.494 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmaSPbBhAAbQv8H2shkFv1Qc92SHenpg==", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2Wpmf6pWExAAmBs2G6jKAffXOyodDkuMFw==", 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.495 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmnJ4JDhAAYE3roXV2yk69qFnL283UnQ==", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmWjrxGhAABbGoGLtPBLRnVlW3FfLM0w==", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCy2WpmivMSBBAAv+ifDEjhacRuMVXqPu7Zxg==", 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.497 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQC12Wpm9YxIAhAAk71Mhrw7n3SudEr/XG1M0Q==", 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.498 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQC42Wpmu2jrABAAf/roDhAfpWJCxejkY73BTQ==", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQC62WpmON28OhAAmmMvSRpOy02FoeNlZ/iALQ==", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQC/2WpmK2hMChAArgIye7KKFXKxEdCH0tFfXg==", 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDC2Wpm6IngCBAAC7IlYfh6njQqqrLtoYoE6w==", 2024-06-13T11:37:50.500 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDF2Wpm2cHEBxAAoW46zMF4QiQCaGfVIUBeJA==", 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.501 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDI2WpmA/q5BRAAXToZ019G5FcWSdbxyGJT/w==", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmIeYsHxAA/BvB+aniAfk6a2V9mayvuw==", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmTElSKBAAGejyWWSxxhh+klYXn8tgrQ==", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.503 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.2", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmNtzwJBAA9t09ECKCJlTXWGr6/eMgWA==", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.3", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmXqEGLhAAYNH72mp9KVcSotncrIJGWQ==", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2024-06-13T11:37:50.504 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg==", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.505 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-mds", 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDS2Wpm9qU6OhAAwhrWIviZ3IbE+TewZOfrQw==", 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-mds" 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-mgr", 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDS2WpmGrE6OhAAWZTL6HjQJcJ+eZP8orG3mQ==", 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-mgr" 2024-06-13T11:37:50.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-osd", 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDS2WpmdLs6OhAA85Y276TqhWOJbbjYnO58kw==", 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-osd" 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rbd", 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDS2WpmbcQ6OhAAzve6WxyKbTeWOk2mIM2uKQ==", 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rbd" 2024-06-13T11:37:50.507 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDS2WpmD806OhAA8wMT5fkd3Dzt2rdXVNAMPA==", 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rgw", 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDS2WpmttU6OhAA9jMMmoYIYZrwOZhC2FkcRA==", 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rgw" 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.508 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCw2WpmEHyIAxAAU5IHH51kHZiueYQCNHbeIg==", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQCv2WpmYECzOhAAzZmv/8bIOofDmzgwKdnQSQ==", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2024-06-13T11:37:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2024-06-13T11:37:50.510 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2024-06-13T11:37:50.510 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.510 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:50.510 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-06-13T11:37:50.510 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f639006be30 msgr2=0x7f639006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f639006be30 0x7f639006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6394000f60 tx=0x7f6394009040 comp rx=0 tx=0).stop 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 msgr2=0x7f63a41e5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a41e5a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f639c00bfa0 tx=0x7f639c004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 shutdown_connections 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f639006be30 0x7f639006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63a415c290 0x7f63a41e5a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f63a4144c20 0x7f63a412e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 --2- 172.21.15.43:0/1217566488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a40721b0 0x7f63a415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 >> 172.21.15.43:0/1217566488 conn(0x7f63a40b14b0 msgr2=0x7f63a415e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 shutdown_connections 2024-06-13T11:37:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.496+0000 7f63a9612640 1 -- 172.21.15.43:0/1217566488 wait complete. 2024-06-13T11:37:50.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-06-13T11:37:50.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.616+0000 7f220417e640 1 Processor -- start 2024-06-13T11:37:50.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.617+0000 7f220417e640 1 -- start start 2024-06-13T11:37:50.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.617+0000 7f220417e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f21fc0d2a90 0x7f21fc0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.617+0000 7f220417e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc0abe00 0x7f21fc0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.617+0000 7f220417e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21fc0aa5d0 con 0x7f21fc155420 2024-06-13T11:37:50.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.617+0000 7f220417e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f21fc0d3440 con 0x7f21fc0d2a90 2024-06-13T11:37:50.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.617+0000 7f220417e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc0aeb90 con 0x7f21fc0abe00 2024-06-13T11:37:50.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201719640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f21fc0d2a90 0x7f21fc0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201f1a640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f21fc155420 0x7f21fc0ae480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43136/0 (socket says 172.21.15.43:43136) 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201719640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f21fc0d2a90 0x7f21fc0d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57676/0 (socket says 172.21.15.43:57676) 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201f1a640 1 -- 172.21.15.43:0/1017387139 learned_addr learned my addr 172.21.15.43:0/1017387139 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f220271b640 1 --2- 172.21.15.43:0/1017387139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc0abe00 0x7f21fc0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201719640 1 -- 172.21.15.43:0/1017387139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc0abe00 msgr2=0x7f21fc0ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201719640 1 --2- 172.21.15.43:0/1017387139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc0abe00 0x7f21fc0ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201719640 1 -- 172.21.15.43:0/1017387139 >> v1:172.21.15.43:6789/0 conn(0x7f21fc155420 legacy=0x7f21fc0ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2201719640 1 -- 172.21.15.43:0/1017387139 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc155800 con 0x7f21fc0d2a90 2024-06-13T11:37:50.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.618+0000 7f2200f18640 1 -- 172.21.15.43:0/1017387139 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049467066 0 0) 0x7f21fc0aa5d0 con 0x7f21fc155420 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f2201719640 1 --2- 172.21.15.43:0/1017387139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc0d2f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0aed70 tx=0x7f21ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edccc392854845e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f2200f18640 1 -- 172.21.15.43:0/1017387139 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec037070 con 0x7f21fc0d2a90 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f2200f18640 1 -- 172.21.15.43:0/1017387139 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec032440 con 0x7f21fc0d2a90 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f2200f18640 1 -- 172.21.15.43:0/1017387139 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec032810 con 0x7f21fc0d2a90 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f220417e640 1 -- 172.21.15.43:0/1017387139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 msgr2=0x7f21fc0d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f220417e640 1 --2- 172.21.15.43:0/1017387139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc0d2f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0aed70 tx=0x7f21ec02a180 comp rx=0 tx=0).stop 2024-06-13T11:37:50.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f220417e640 1 -- 172.21.15.43:0/1017387139 shutdown_connections 2024-06-13T11:37:50.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f220417e640 1 --2- 172.21.15.43:0/1017387139 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc0abe00 0x7f21fc0ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f220417e640 1 --2- 172.21.15.43:0/1017387139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc0d2f00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.619+0000 7f220417e640 1 -- 172.21.15.43:0/1017387139 >> 172.21.15.43:0/1017387139 conn(0x7f21fc067640 msgr2=0x7f21fc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:50.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.620+0000 7f220417e640 1 -- 172.21.15.43:0/1017387139 shutdown_connections 2024-06-13T11:37:50.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.620+0000 7f220417e640 1 -- 172.21.15.43:0/1017387139 wait complete. 2024-06-13T11:37:50.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 Processor -- start 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 -- start start 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21fc0abe00 0x7f21fc147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc1622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc155420 0x7f21fc161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc0aae30 con 0x7f21fc0d2a90 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc0aab50 con 0x7f21fc0abe00 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.621+0000 7f220417e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc0ab110 con 0x7f21fc155420 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc1622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc1622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57690/0 (socket says 172.21.15.43:57690) 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 -- 172.21.15.43:0/2540798388 learned_addr learned my addr 172.21.15.43:0/2540798388 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f220271b640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc155420 0x7f21fc161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201f1a640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21fc0abe00 0x7f21fc147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 -- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc155420 msgr2=0x7f21fc161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc155420 0x7f21fc161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 -- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21fc0abe00 msgr2=0x7f21fc147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21fc0abe00 0x7f21fc147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 -- 172.21.15.43:0/2540798388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc155ef0 con 0x7f21fc0d2a90 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201f1a640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21fc0abe00 0x7f21fc147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f2201719640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc1622a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21ec000c00 tx=0x7f21ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec037040 con 0x7f21fc0d2a90 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec042070 con 0x7f21fc0d2a90 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc1561d0 con 0x7f21fc0d2a90 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec030960 con 0x7f21fc0d2a90 2024-06-13T11:37:50.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.622+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc156cb0 con 0x7f21fc0d2a90 2024-06-13T11:37:50.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.623+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21fc04ffb0 con 0x7f21fc0d2a90 2024-06-13T11:37:50.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.624+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21ec030b00 con 0x7f21fc0d2a90 2024-06-13T11:37:50.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.624+0000 7f21f27fc640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f21e006be30 0x7f21e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:50.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.624+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f21ec0ab550 con 0x7f21fc0d2a90 2024-06-13T11:37:50.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.624+0000 7f2201f1a640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f21e006be30 0x7f21e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:50.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.625+0000 7f2201f1a640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f21e006be30 0x7f21e006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f21f8000f60 tx=0x7f21f8007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:50.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.628+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f21ec07a0c0 con 0x7f21fc0d2a90 2024-06-13T11:37:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.890+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f21fc0ab920 con 0x7f21fc0d2a90 2024-06-13T11:37:50.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.892+0000 7f21f27fc640 1 -- 172.21.15.43:0/2540798388 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f21ec0799c0 con 0x7f21fc0d2a90 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f21e006be30 msgr2=0x7f21e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f21e006be30 0x7f21e006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f21f8000f60 tx=0x7f21f8007c10 comp rx=0 tx=0).stop 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 msgr2=0x7f21fc1622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc1622a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21ec000c00 tx=0x7f21ec0046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 shutdown_connections 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f21e006be30 0x7f21e006e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f21fc155420 0x7f21fc161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21fc0d2a90 0x7f21fc1622a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 --2- 172.21.15.43:0/2540798388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21fc0abe00 0x7f21fc147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.894+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 >> 172.21.15.43:0/2540798388 conn(0x7f21fc067640 msgr2=0x7f21fc070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.895+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 shutdown_connections 2024-06-13T11:37:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:50.895+0000 7f220417e640 1 -- 172.21.15.43:0/2540798388 wait complete. 2024-06-13T11:37:50.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-06-13T11:37:51.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.010+0000 7f7585838640 1 Processor -- start 2024-06-13T11:37:51.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.011+0000 7f7585838640 1 -- start start 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.011+0000 7f7585838640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 0x7f758015b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.011+0000 7f7585838640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7580071140 con 0x7f75800b0de0 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.011+0000 7f7585838640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75800cc6d0 con 0x7f75800cf780 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.011+0000 7f7585838640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f75800cc480 con 0x7f7580154fb0 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757e7fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f75800b0de0 0x7f75800cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43152/0 (socket says 172.21.15.43:43152) 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757e7fc640 1 -- 172.21.15.43:0/819250449 learned_addr learned my addr 172.21.15.43:0/819250449 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757effd640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 0x7f758015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796015043 0 0) 0x7f7580071140 con 0x7f75800b0de0 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f756c003520 con 0x7f75800b0de0 2024-06-13T11:37:51.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929883234 0 0) 0x7f75800cc6d0 con 0x7f75800cf780 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7580071140 con 0x7f75800cf780 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1542408625 0 0) 0x7f756c003520 con 0x7f75800b0de0 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 msgr2=0x7f758015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 0x7f758015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 >> v1:172.21.15.53:6789/0 conn(0x7f75800cf780 legacy=0x7f7580071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75800713b0 con 0x7f75800b0de0 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f7568001670 con 0x7f75800b0de0 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 >> v1:172.21.15.43:6789/0 conn(0x7f75800b0de0 legacy=0x7f75800cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f756c003b70 0x7f756c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 0x7f756c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f756c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75800cc480 con 0x7f756c004d40 2024-06-13T11:37:51.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f756c00dc80 con 0x7f756c003b70 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f756c00de30 con 0x7f7580154fb0 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.012+0000 7f757f7fe640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f756c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757effd640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f756c003b70 0x7f756c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757e7fc640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 0x7f756c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757f7fe640 1 -- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 msgr2=0x7f756c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757f7fe640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580154fb0 0x7f756c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757f7fe640 1 -- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f756c003b70 msgr2=0x7f756c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757f7fe640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f756c003b70 0x7f756c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757f7fe640 1 -- 172.21.15.43:0/819250449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c003520 con 0x7f756c004d40 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.013+0000 7f757f7fe640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f756c0051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7570001fa0 tx=0x7f756c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330f185dfbd5dcd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570001bf0 con 0x7f756c004d40 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7570003b70 con 0x7f756c004d40 2024-06-13T11:37:51.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f757dffb640 1 -- 172.21.15.43:0/819250449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75700050d0 con 0x7f756c004d40 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f7585838640 1 -- 172.21.15.43:0/819250449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 msgr2=0x7f756c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f7585838640 1 --2- 172.21.15.43:0/819250449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f756c0051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7570001fa0 tx=0x7f756c005830 comp rx=0 tx=0).stop 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f757f7fe640 1 -- 172.21.15.43:0/819250449 reap_dead start 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f7585838640 1 -- 172.21.15.43:0/819250449 shutdown_connections 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f7585838640 1 -- 172.21.15.43:0/819250449 >> 172.21.15.43:0/819250449 conn(0x7f75800b14b0 msgr2=0x7f75800b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f7585838640 1 -- 172.21.15.43:0/819250449 shutdown_connections 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.014+0000 7f7585838640 1 -- 172.21.15.43:0/819250449 wait complete. 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.015+0000 7f7585838640 1 Processor -- start 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 -- start start 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f7580140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580157e20 0x7f75801e1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75801e1990 0x7f75801e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75800cc9b0 con 0x7f756c004d40 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7580155390 con 0x7f75801e1990 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.016+0000 7f7585838640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f75800cd130 con 0x7f7580157e20 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f7580140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f7580140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57702/0 (socket says 172.21.15.43:57702) 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 -- 172.21.15.43:0/2069873587 learned_addr learned my addr 172.21.15.43:0/2069873587 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757f7fe640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75801e1990 0x7f75801e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 -- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580157e20 msgr2=0x7f75801e1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757e7fc640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580157e20 0x7f75801e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580157e20 0x7f75801e1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 -- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75801e1990 msgr2=0x7f75801e21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75801e1990 0x7f75801e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 -- 172.21.15.43:0/2069873587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7580156d80 con 0x7f756c004d40 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f757effd640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f7580140be0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f75780119a0 tx=0x7f7578011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757800faf0 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757800fc90 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7580157060 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578014440 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.017+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7580157620 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.018+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758004ffb0 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.019+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7578012040 con 0x7f756c004d40 2024-06-13T11:37:51.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.019+0000 7f7577fff640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f756006be60 0x7f756006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.019+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f757808b3a0 con 0x7f756c004d40 2024-06-13T11:37:51.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.020+0000 7f757e7fc640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f756006be60 0x7f756006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.020+0000 7f757e7fc640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f756006be60 0x7f756006e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7580158690 tx=0x7f7568001e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.024+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7578019030 con 0x7f756c004d40 2024-06-13T11:37:51.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.281+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f758006e530 con 0x7f756c004d40 2024-06-13T11:37:51.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.283+0000 7f7577fff640 1 -- 172.21.15.43:0/2069873587 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f7578059f10 con 0x7f756c004d40 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f756006be60 msgr2=0x7f756006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f756006be60 0x7f756006e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7580158690 tx=0x7f7568001e30 comp rx=0 tx=0).stop 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 msgr2=0x7f7580140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f7580140be0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f75780119a0 tx=0x7f7578011e60 comp rx=0 tx=0).stop 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 shutdown_connections 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f756006be60 0x7f756006e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75801e1990 0x7f75801e21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7580157e20 0x7f75801e1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 --2- 172.21.15.43:0/2069873587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f756c004d40 0x7f7580140be0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 >> 172.21.15.43:0/2069873587 conn(0x7f75800b14b0 msgr2=0x7f75800b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:51.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 shutdown_connections 2024-06-13T11:37:51.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.285+0000 7f7585838640 1 -- 172.21.15.43:0/2069873587 wait complete. 2024-06-13T11:37:51.296 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-06-13T11:37:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.401+0000 7f08f8db0640 1 Processor -- start 2024-06-13T11:37:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.401+0000 7f08f8db0640 1 -- start start 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f8db0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08f415c250 0x7f08f4071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f8db0640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f40b09f0 con 0x7f08f4072b90 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f8db0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f4071dd0 con 0x7f08f40cf580 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f8db0640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f08f4072700 con 0x7f08f415c250 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f259c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08f415c250 0x7f08f4071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f259c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08f415c250 0x7f08f4071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57704/0 (socket says 172.21.15.43:57704) 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f259c640 1 -- 172.21.15.43:0/1646462799 learned_addr learned my addr 172.21.15.43:0/1646462799 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.402+0000 7f08f1d9b640 1 --1- 172.21.15.43:0/1646462799 >> v1:172.21.15.43:6789/0 conn(0x7f08f4072b90 0x7f08f40cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43164/0 (socket says 172.21.15.43:43164) 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.403+0000 7f08f259c640 1 -- 172.21.15.43:0/1646462799 >> v1:172.21.15.53:6789/0 conn(0x7f08f40cf580 legacy=0x7f08f40a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.403+0000 7f08f259c640 1 -- 172.21.15.43:0/1646462799 >> v1:172.21.15.43:6789/0 conn(0x7f08f4072b90 legacy=0x7f08f40cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.403+0000 7f08f159a640 1 -- 172.21.15.43:0/1646462799 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840099203 0 0) 0x7f08f40b09f0 con 0x7f08f4072b90 2024-06-13T11:37:51.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.403+0000 7f08f259c640 1 -- 172.21.15.43:0/1646462799 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f40720b0 con 0x7f08f415c250 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.403+0000 7f08f259c640 1 --2- 172.21.15.43:0/1646462799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f415c250 0x7f08f4071220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009e50 tx=0x7f08e402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0d14c24b6a4879 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f159a640 1 -- 172.21.15.43:0/1646462799 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4036070 con 0x7f08f415c250 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f159a640 1 -- 172.21.15.43:0/1646462799 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e4031600 con 0x7f08f415c250 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f159a640 1 -- 172.21.15.43:0/1646462799 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e40319d0 con 0x7f08f415c250 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 -- 172.21.15.43:0/1646462799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f415c250 msgr2=0x7f08f4071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 --2- 172.21.15.43:0/1646462799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f415c250 0x7f08f4071220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009e50 tx=0x7f08e402a760 comp rx=0 tx=0).stop 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 -- 172.21.15.43:0/1646462799 shutdown_connections 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 --2- 172.21.15.43:0/1646462799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f415c250 0x7f08f4071220 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 -- 172.21.15.43:0/1646462799 >> 172.21.15.43:0/1646462799 conn(0x7f08f40b14b0 msgr2=0x7f08f40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 -- 172.21.15.43:0/1646462799 shutdown_connections 2024-06-13T11:37:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.404+0000 7f08f8db0640 1 -- 172.21.15.43:0/1646462799 wait complete. 2024-06-13T11:37:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 Processor -- start 2024-06-13T11:37:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 -- start start 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08f4072b90 0x7f08f4158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 0x7f08f415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f08f415c250 0x7f08f4147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415c7b0 con 0x7f08f40cf580 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415c630 con 0x7f08f4072b90 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.406+0000 7f08f8db0640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f08f40b0e30 con 0x7f08f415c250 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 0x7f08f415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 0x7f08f415a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57714/0 (socket says 172.21.15.43:57714) 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 -- 172.21.15.43:0/2072162621 learned_addr learned my addr 172.21.15.43:0/2072162621 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f259c640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08f4072b90 0x7f08f4158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f2d9d640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f08f415c250 0x7f08f4147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 -- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f08f415c250 msgr2=0x7f08f4147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f08f415c250 0x7f08f4147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 -- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08f4072b90 msgr2=0x7f08f4158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08f4072b90 0x7f08f4158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 -- 172.21.15.43:0/2072162621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f415a7a0 con 0x7f08f40cf580 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f1d9b640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 0x7f08f415a260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c4b0 tx=0x7f08dc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc018070 con 0x7f08f40cf580 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc007500 con 0x7f08f40cf580 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f41484c0 con 0x7f08f40cf580 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc004a20 con 0x7f08f40cf580 2024-06-13T11:37:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.407+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f4158af0 con 0x7f08f40cf580 2024-06-13T11:37:51.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.408+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f404ffb0 con 0x7f08f40cf580 2024-06-13T11:37:51.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.409+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08dc01b070 con 0x7f08f40cf580 2024-06-13T11:37:51.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.409+0000 7f08eaffd640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f08d406be30 0x7f08d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.410+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f08dc089f70 con 0x7f08f40cf580 2024-06-13T11:37:51.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.410+0000 7f08f259c640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f08d406be30 0x7f08d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.410+0000 7f08f259c640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f08d406be30 0x7f08d406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08e4033000 tx=0x7f08e4009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.414+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f08f41484c0 con 0x7f08f40cf580 2024-06-13T11:37:51.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.677+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f08f415a9d0 con 0x7f08f40cf580 2024-06-13T11:37:51.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.678+0000 7f08eaffd640 1 -- 172.21.15.43:0/2072162621 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f08dc058550 con 0x7f08f40cf580 2024-06-13T11:37:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f08d406be30 msgr2=0x7f08d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f08d406be30 0x7f08d406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08e4033000 tx=0x7f08e4009000 comp rx=0 tx=0).stop 2024-06-13T11:37:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 msgr2=0x7f08f415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 0x7f08f415a260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c4b0 tx=0x7f08dc00c970 comp rx=0 tx=0).stop 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 shutdown_connections 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f08d406be30 0x7f08d406e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f08f415c250 0x7f08f4147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08f40cf580 0x7f08f415a260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 --2- 172.21.15.43:0/2072162621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08f4072b90 0x7f08f4158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 >> 172.21.15.43:0/2072162621 conn(0x7f08f40b14b0 msgr2=0x7f08f40a9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 shutdown_connections 2024-06-13T11:37:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.681+0000 7f08f8db0640 1 -- 172.21.15.43:0/2072162621 wait complete. 2024-06-13T11:37:51.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-06-13T11:37:51.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.796+0000 7f775d3a5640 1 Processor -- start 2024-06-13T11:37:51.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.796+0000 7f775d3a5640 1 -- start start 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f775d3a5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7758144d40 0x7f77580718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f775d3a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77580d0dd0 0x7f77580d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f775d3a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7758071ea0 con 0x7f7758072f40 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f775d3a5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7758072180 con 0x7f7758144d40 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f775d3a5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7758072460 con 0x7f77580d0dd0 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7758144d40 0x7f77580718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7758144d40 0x7f77580718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57722/0 (socket says 172.21.15.43:57722) 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 -- 172.21.15.43:0/137870858 learned_addr learned my addr 172.21.15.43:0/137870858 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f77577fe640 1 --2- 172.21.15.43:0/137870858 >> v2:172.21.15.53:3300/0 conn(0x7f77580d0dd0 0x7f77580d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 -- 172.21.15.43:0/137870858 >> v2:172.21.15.53:3300/0 conn(0x7f77580d0dd0 msgr2=0x7f77580d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:51.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 --2- 172.21.15.43:0/137870858 >> v2:172.21.15.53:3300/0 conn(0x7f77580d0dd0 0x7f77580d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 -- 172.21.15.43:0/137870858 >> v1:172.21.15.53:6789/0 conn(0x7f7758072f40 legacy=0x7f77580d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.797+0000 7f7756ffd640 1 -- 172.21.15.43:0/137870858 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7758072740 con 0x7f7758144d40 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.798+0000 7f7756ffd640 1 --2- 172.21.15.43:0/137870858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7758144d40 0x7f77580718c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f77580adc10 tx=0x7f775002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d5b00310da3c45 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.798+0000 7f7755ffb640 1 -- 172.21.15.43:0/137870858 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750037070 con 0x7f7758144d40 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.798+0000 7f7755ffb640 1 -- 172.21.15.43:0/137870858 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750032440 con 0x7f7758144d40 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.798+0000 7f7755ffb640 1 -- 172.21.15.43:0/137870858 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750032810 con 0x7f7758144d40 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 -- 172.21.15.43:0/137870858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7758144d40 msgr2=0x7f77580718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 --2- 172.21.15.43:0/137870858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7758144d40 0x7f77580718c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f77580adc10 tx=0x7f775002a270 comp rx=0 tx=0).stop 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 -- 172.21.15.43:0/137870858 shutdown_connections 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 --2- 172.21.15.43:0/137870858 >> v2:172.21.15.53:3300/0 conn(0x7f77580d0dd0 0x7f77580d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 --2- 172.21.15.43:0/137870858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7758144d40 0x7f77580718c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 -- 172.21.15.43:0/137870858 >> 172.21.15.43:0/137870858 conn(0x7f7758070810 msgr2=0x7f7758070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 -- 172.21.15.43:0/137870858 shutdown_connections 2024-06-13T11:37:51.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.799+0000 7f775d3a5640 1 -- 172.21.15.43:0/137870858 wait complete. 2024-06-13T11:37:51.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.800+0000 7f775d3a5640 1 Processor -- start 2024-06-13T11:37:51.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.800+0000 7f775d3a5640 1 -- start start 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f775d3a5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7758072f40 0x7f77580aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f775d3a5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 0x7f77580b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f775d3a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7758144d40 0x7f775815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f775d3a5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7758145120 con 0x7f77580d0dd0 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f775d3a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f77580733a0 con 0x7f7758144d40 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f775d3a5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f77580afc70 con 0x7f7758072f40 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f77567fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 0x7f77580b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f77567fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 0x7f77580b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57730/0 (socket says 172.21.15.43:57730) 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f77567fc640 1 -- 172.21.15.43:0/649332625 learned_addr learned my addr 172.21.15.43:0/649332625 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f77577fe640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7758144d40 0x7f775815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f7756ffd640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7758072f40 0x7f77580aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f77567fc640 1 -- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7758072f40 msgr2=0x7f77580aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.801+0000 7f77567fc640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7758072f40 0x7f77580aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f77567fc640 1 -- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7758144d40 msgr2=0x7f775815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f77567fc640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7758144d40 0x7f775815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f77567fc640 1 -- 172.21.15.43:0/649332625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580af3d0 con 0x7f77580d0dd0 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f77567fc640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 0x7f77580b0fe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f774000c400 tx=0x7f774000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77400052d0 con 0x7f77580d0dd0 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7740005490 con 0x7f77580d0dd0 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77580af6b0 con 0x7f77580d0dd0 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740007260 con 0x7f77580d0dd0 2024-06-13T11:37:51.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.802+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775815aab0 con 0x7f77580d0dd0 2024-06-13T11:37:51.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.803+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775804ffb0 con 0x7f77580d0dd0 2024-06-13T11:37:51.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.803+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7740007400 con 0x7f77580d0dd0 2024-06-13T11:37:51.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.804+0000 7f774f7fe640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f773806be30 0x7f773806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:51.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.804+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f774008a0a0 con 0x7f77580d0dd0 2024-06-13T11:37:51.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.804+0000 7f7756ffd640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f773806be30 0x7f773806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:51.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.805+0000 7f7756ffd640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f773806be30 0x7f773806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7750034000 tx=0x7f775002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:51.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:51.808+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7740058650 con 0x7f77580d0dd0 2024-06-13T11:37:52.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.062+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f77580b1580 con 0x7f77580d0dd0 2024-06-13T11:37:52.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.064+0000 7f774f7fe640 1 -- 172.21.15.43:0/649332625 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f774005c950 con 0x7f77580d0dd0 2024-06-13T11:37:52.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f773806be30 msgr2=0x7f773806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f773806be30 0x7f773806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7750034000 tx=0x7f775002e000 comp rx=0 tx=0).stop 2024-06-13T11:37:52.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 msgr2=0x7f77580b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 0x7f77580b0fe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f774000c400 tx=0x7f774000c8c0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 shutdown_connections 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f773806be30 0x7f773806e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7758144d40 0x7f775815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77580d0dd0 0x7f77580b0fe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 --2- 172.21.15.43:0/649332625 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7758072f40 0x7f77580aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 >> 172.21.15.43:0/649332625 conn(0x7f7758070810 msgr2=0x7f7758147440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 shutdown_connections 2024-06-13T11:37:52.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.066+0000 7f775d3a5640 1 -- 172.21.15.43:0/649332625 wait complete. 2024-06-13T11:37:52.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-06-13T11:37:52.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.182+0000 7f53398b3640 1 Processor -- start 2024-06-13T11:37:52.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.182+0000 7f53398b3640 1 -- start start 2024-06-13T11:37:52.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f53398b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5334144d40 0x7f53340718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f53398b3640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5334071ea0 con 0x7f5334072f40 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f53398b3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5334072180 con 0x7f53340d0dd0 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f53398b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5334072460 con 0x7f5334144d40 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f53327fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5334072f40 0x7f53340d0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43170/0 (socket says 172.21.15.43:43170) 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f53327fc640 1 -- 172.21.15.43:0/918966680 learned_addr learned my addr 172.21.15.43:0/918966680 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854703140 0 0) 0x7f5334071ea0 con 0x7f5334072f40 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5332ffd640 1 --2- 172.21.15.43:0/918966680 >> v2:172.21.15.53:3300/0 conn(0x7f5334144d40 0x7f53340718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f531c003520 con 0x7f5334072f40 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593589589 0 0) 0x7f531c003520 con 0x7f5334072f40 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 >> v2:172.21.15.53:3300/0 conn(0x7f5334144d40 msgr2=0x7f53340718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 --2- 172.21.15.43:0/918966680 >> v2:172.21.15.53:3300/0 conn(0x7f5334144d40 0x7f53340718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 >> v1:172.21.15.53:6789/0 conn(0x7f53340d0dd0 legacy=0x7f5334145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5334072740 con 0x7f5334072f40 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f5328001670 con 0x7f5334072f40 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 >> v1:172.21.15.43:6789/0 conn(0x7f5334072f40 legacy=0x7f53340d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f531c0039b0 0x7f531c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f531c004800 0x7f531c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f531c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5334072460 con 0x7f531c0051c0 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f531c00c060 con 0x7f531c0039b0 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.183+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f531c00c260 con 0x7f531c004800 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53337fe640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f531c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f5332ffd640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f531c0039b0 0x7f531c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53327fc640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f531c004800 0x7f531c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53337fe640 1 -- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f531c004800 msgr2=0x7f531c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53337fe640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f531c004800 0x7f531c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53337fe640 1 -- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f531c0039b0 msgr2=0x7f531c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53337fe640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f531c0039b0 0x7f531c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.184+0000 7f53337fe640 1 -- 172.21.15.43:0/918966680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c003520 con 0x7f531c0051c0 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53337fe640 1 -- 172.21.15.43:0/918966680 reap_dead start 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53337fe640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f531c00b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f532c001e50 tx=0x7f531c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e90059668b61aa server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c001a70 con 0x7f531c0051c0 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c003970 con 0x7f531c0051c0 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f5331ffb640 1 -- 172.21.15.43:0/918966680 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c003d60 con 0x7f531c0051c0 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 -- 172.21.15.43:0/918966680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 msgr2=0x7f531c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f531c00b9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f532c001e50 tx=0x7f531c005830 comp rx=0 tx=0).stop 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 -- 172.21.15.43:0/918966680 shutdown_connections 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 --2- 172.21.15.43:0/918966680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f531c00b9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 -- 172.21.15.43:0/918966680 >> 172.21.15.43:0/918966680 conn(0x7f5334070810 msgr2=0x7f5334070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 -- 172.21.15.43:0/918966680 shutdown_connections 2024-06-13T11:37:52.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.185+0000 7f53398b3640 1 -- 172.21.15.43:0/918966680 wait complete. 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.186+0000 7f53398b3640 1 Processor -- start 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 -- start start 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f53340b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f533413f9c0 0x7f533413fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53340c3d40 0x7f53340c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5334145120 con 0x7f531c0051c0 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f53340733a0 con 0x7f533413f9c0 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f53398b3640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f53340c4a90 con 0x7f53340c3d40 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.187+0000 7f5332ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f53340b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f53340b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57750/0 (socket says 172.21.15.43:57750) 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 -- 172.21.15.43:0/3376477106 learned_addr learned my addr 172.21.15.43:0/3376477106 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f53337fe640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53340c3d40 0x7f53340c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f53327fc640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f533413f9c0 0x7f533413fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 -- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53340c3d40 msgr2=0x7f53340c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53340c3d40 0x7f53340c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 -- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f533413f9c0 msgr2=0x7f533413fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f533413f9c0 0x7f533413fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 -- 172.21.15.43:0/3376477106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53340c4d70 con 0x7f531c0051c0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f5332ffd640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f53340b2ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f53240118e0 tx=0x7f5324011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532400fa30 con 0x7f531c0051c0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532400fbd0 con 0x7f531c0051c0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53340c5050 con 0x7f531c0051c0 2024-06-13T11:37:52.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324014440 con 0x7f531c0051c0 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.188+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5334140360 con 0x7f531c0051c0 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.189+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533404ffb0 con 0x7f531c0051c0 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.190+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5324012040 con 0x7f531c0051c0 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.190+0000 7f531bfff640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f532006be60 0x7f532006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.190+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f532408b120 con 0x7f531c0051c0 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.191+0000 7f53327fc640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f532006be60 0x7f532006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.191+0000 7f53327fc640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f532006be60 0x7f532006e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5334161a40 tx=0x7f5328000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.195+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5324019030 con 0x7f531c0051c0 2024-06-13T11:37:52.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.454+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f5334071620 con 0x7f531c0051c0 2024-06-13T11:37:52.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.456+0000 7f531bfff640 1 -- 172.21.15.43:0/3376477106 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f5324059d20 con 0x7f531c0051c0 2024-06-13T11:37:52.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f532006be60 msgr2=0x7f532006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f532006be60 0x7f532006e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5334161a40 tx=0x7f5328000ed0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 msgr2=0x7f53340b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f53340b2ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f53240118e0 tx=0x7f5324011ce0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 shutdown_connections 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f532006be60 0x7f532006e320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f53340c3d40 0x7f53340c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f533413f9c0 0x7f533413fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 --2- 172.21.15.43:0/3376477106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f531c0051c0 0x7f53340b2ca0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 >> 172.21.15.43:0/3376477106 conn(0x7f5334070810 msgr2=0x7f5334141ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 shutdown_connections 2024-06-13T11:37:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.458+0000 7f53398b3640 1 -- 172.21.15.43:0/3376477106 wait complete. 2024-06-13T11:37:52.469 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-06-13T11:37:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.573+0000 7fbeac33b640 1 Processor -- start 2024-06-13T11:37:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.573+0000 7fbeac33b640 1 -- start start 2024-06-13T11:37:52.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.574+0000 7fbeac33b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbea4155420 0x7fbea40ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.574+0000 7fbeac33b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea40abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.574+0000 7fbeac33b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea40aa5d0 con 0x7fbea40ae9c0 2024-06-13T11:37:52.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.574+0000 7fbeac33b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbea4155800 con 0x7fbea4155420 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.574+0000 7fbeac33b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbea40aa870 con 0x7fbea40d31a0 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.574+0000 7fbea98d6640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbea40ae9c0 0x7fbea40d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43180/0 (socket says 172.21.15.43:43180) 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbea98d6640 1 -- 172.21.15.43:0/1713310334 learned_addr learned my addr 172.21.15.43:0/1713310334 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa8d8640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea40abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa0d7640 1 --2- 172.21.15.43:0/1713310334 >> v2:172.21.15.53:3300/0 conn(0x7fbea4155420 0x7fbea40ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbea90d5640 1 -- 172.21.15.43:0/1713310334 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710436231 0 0) 0x7fbea40aa5d0 con 0x7fbea40ae9c0 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbea90d5640 1 -- 172.21.15.43:0/1713310334 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe8c003520 con 0x7fbea40ae9c0 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa0d7640 1 -- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 msgr2=0x7fbea40abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa0d7640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea40abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbea90d5640 1 -- 172.21.15.43:0/1713310334 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1541183250 0 0) 0x7fbe8c003520 con 0x7fbea40ae9c0 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa0d7640 1 -- 172.21.15.43:0/1713310334 >> v1:172.21.15.43:6789/0 conn(0x7fbea40ae9c0 legacy=0x7fbea40d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa0d7640 1 -- 172.21.15.43:0/1713310334 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea40aab50 con 0x7fbea4155420 2024-06-13T11:37:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.575+0000 7fbeaa8d8640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea40abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.576+0000 7fbeaa0d7640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea4155420 0x7fbea40ae480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009d90 tx=0x7fbe9402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=166b27ded060fc1c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.576+0000 7fbea90d5640 1 -- 172.21.15.43:0/1713310334 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98001690 con 0x7fbea4155420 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.576+0000 7fbea90d5640 1 -- 172.21.15.43:0/1713310334 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe94007540 con 0x7fbea4155420 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.576+0000 7fbea90d5640 1 -- 172.21.15.43:0/1713310334 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe940078f0 con 0x7fbea4155420 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 -- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea4155420 msgr2=0x7fbea40ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea4155420 0x7fbea40ae480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009d90 tx=0x7fbe9402a5f0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 -- 172.21.15.43:0/1713310334 shutdown_connections 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea40abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 --2- 172.21.15.43:0/1713310334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea4155420 0x7fbea40ae480 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 -- 172.21.15.43:0/1713310334 >> 172.21.15.43:0/1713310334 conn(0x7fbea4067640 msgr2=0x7fbea40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 -- 172.21.15.43:0/1713310334 shutdown_connections 2024-06-13T11:37:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.577+0000 7fbeac33b640 1 -- 172.21.15.43:0/1713310334 wait complete. 2024-06-13T11:37:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.578+0000 7fbeac33b640 1 Processor -- start 2024-06-13T11:37:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.578+0000 7fbeac33b640 1 -- start start 2024-06-13T11:37:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeac33b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea40ae9c0 0x7fbea40b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeac33b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea4157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeac33b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 0x7fbea414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeac33b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbea40ab630 con 0x7fbea4155420 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeac33b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbea40ab110 con 0x7fbea40ae9c0 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeac33b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbea40adfb0 con 0x7fbea40d31a0 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 0x7fbea414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 0x7fbea414ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57758/0 (socket says 172.21.15.43:57758) 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 -- 172.21.15.43:0/316170953 learned_addr learned my addr 172.21.15.43:0/316170953 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa0d7640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea40ae9c0 0x7fbea40b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbea98d6640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea4157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 -- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 msgr2=0x7fbea4157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea4157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 -- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea40ae9c0 msgr2=0x7fbea40b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea40ae9c0 0x7fbea40b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 -- 172.21.15.43:0/316170953 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea41578c0 con 0x7fbea4155420 2024-06-13T11:37:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.579+0000 7fbeaa8d8640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 0x7fbea414ea70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00e930 tx=0x7fbe9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.580+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c017070 con 0x7fbea4155420 2024-06-13T11:37:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.580+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea4157b40 con 0x7fbea4155420 2024-06-13T11:37:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.580+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00ca00 con 0x7fbea4155420 2024-06-13T11:37:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.580+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00cdd0 con 0x7fbea4155420 2024-06-13T11:37:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.580+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea4158100 con 0x7fbea4155420 2024-06-13T11:37:52.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.580+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea415c2f0 con 0x7fbea4155420 2024-06-13T11:37:52.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.581+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe9c013470 con 0x7fbea4155420 2024-06-13T11:37:52.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.582+0000 7fbea2ffd640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe9006be30 0x7fbe9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.582+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fbe9c08a800 con 0x7fbea4155420 2024-06-13T11:37:52.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.582+0000 7fbeaa0d7640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe9006be30 0x7fbe9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.582+0000 7fbeaa0d7640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe9006be30 0x7fbe9006e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe94034000 tx=0x7fbe9402f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.586+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbea41578c0 con 0x7fbea4155420 2024-06-13T11:37:52.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.846+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fbea404ffb0 con 0x7fbea4155420 2024-06-13T11:37:52.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.848+0000 7fbea2ffd640 1 -- 172.21.15.43:0/316170953 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fbe9c058d60 con 0x7fbea4155420 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe9006be30 msgr2=0x7fbe9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe9006be30 0x7fbe9006e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe94034000 tx=0x7fbe9402f000 comp rx=0 tx=0).stop 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 msgr2=0x7fbea414ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 0x7fbea414ea70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00e930 tx=0x7fbe9c00edf0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 shutdown_connections 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbe9006be30 0x7fbe9006e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbea4155420 0x7fbea414ea70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbea40d31a0 0x7fbea4157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 --2- 172.21.15.43:0/316170953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbea40ae9c0 0x7fbea40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 >> 172.21.15.43:0/316170953 conn(0x7fbea4067640 msgr2=0x7fbea414fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 shutdown_connections 2024-06-13T11:37:52.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.850+0000 7fbeac33b640 1 -- 172.21.15.43:0/316170953 wait complete. 2024-06-13T11:37:52.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-13T11:37:52.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.965+0000 7fa6505c8640 1 Processor -- start 2024-06-13T11:37:52.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.965+0000 7fa6505c8640 1 -- start start 2024-06-13T11:37:52.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa6505c8640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 0x7fa648071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa6505c8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6480cf580 0x7fa6480a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa6505c8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6480b09f0 con 0x7fa648072b90 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa6505c8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa648072700 con 0x7fa6480cf580 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa6505c8640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa648071dd0 con 0x7fa64815c250 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64db63640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa648072b90 0x7fa6480cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37040/0 (socket says 172.21.15.43:37040) 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64db63640 1 -- 172.21.15.43:0/1162296874 learned_addr learned my addr 172.21.15.43:0/1162296874 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127098576 0 0) 0x7fa6480b09f0 con 0x7fa648072b90 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64e364640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 0x7fa648071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64eb65640 1 --2- 172.21.15.43:0/1162296874 >> v2:172.21.15.53:3300/0 conn(0x7fa6480cf580 0x7fa6480a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa634003520 con 0x7fa648072b90 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3177029209 0 0) 0x7fa634003520 con 0x7fa648072b90 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 msgr2=0x7fa648071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 0x7fa648071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 >> v2:172.21.15.53:3300/0 conn(0x7fa6480cf580 msgr2=0x7fa6480a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 --2- 172.21.15.43:0/1162296874 >> v2:172.21.15.53:3300/0 conn(0x7fa6480cf580 0x7fa6480a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6480720b0 con 0x7fa648072b90 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fa638001670 con 0x7fa648072b90 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.966+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 >> v1:172.21.15.43:6789/0 conn(0x7fa648072b90 legacy=0x7fa6480cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64d362640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6340039b0 0x7fa634003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64d362640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 0x7fa634004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64d362640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa6340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa648072700 con 0x7fa634004d40 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa648071dd0 con 0x7fa6340039b0 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa63400b9c0 con 0x7fa64815c250 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64eb65640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa6340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64e364640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6340039b0 0x7fa634003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64db63640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 0x7fa634004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64eb65640 1 -- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 msgr2=0x7fa634004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64eb65640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa64815c250 0x7fa634004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64eb65640 1 -- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6340039b0 msgr2=0x7fa634003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:52.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64eb65640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6340039b0 0x7fa634003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.967+0000 7fa64eb65640 1 -- 172.21.15.43:0/1162296874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa634003520 con 0x7fa634004d40 2024-06-13T11:37:52.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa64eb65640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa6340051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa648073790 tx=0x7fa634005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c62b78cb8769487 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640009c10 con 0x7fa634004d40 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa640036070 con 0x7fa634004d40 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa64d362640 1 -- 172.21.15.43:0/1162296874 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640031850 con 0x7fa634004d40 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa6505c8640 1 -- 172.21.15.43:0/1162296874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 msgr2=0x7fa6340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa6505c8640 1 --2- 172.21.15.43:0/1162296874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa6340051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa648073790 tx=0x7fa634005830 comp rx=0 tx=0).stop 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa64eb65640 1 -- 172.21.15.43:0/1162296874 reap_dead start 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa6505c8640 1 -- 172.21.15.43:0/1162296874 shutdown_connections 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa6505c8640 1 -- 172.21.15.43:0/1162296874 >> 172.21.15.43:0/1162296874 conn(0x7fa6480b14b0 msgr2=0x7fa6480b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.968+0000 7fa6505c8640 1 -- 172.21.15.43:0/1162296874 shutdown_connections 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.969+0000 7fa6505c8640 1 -- 172.21.15.43:0/1162296874 wait complete. 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 Processor -- start 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 -- start start 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa64814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6481f3d70 0x7fa6481f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6480cdda0 0x7fa6480ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa64815c7b0 con 0x7fa634004d40 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa64815c630 con 0x7fa6481f3d70 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.970+0000 7fa6505c8640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa6480b0e30 con 0x7fa6480cdda0 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa64814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa64814c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54828/0 (socket says 172.21.15.43:54828) 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 -- 172.21.15.43:0/830164415 learned_addr learned my addr 172.21.15.43:0/830164415 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64db63640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6481f3d70 0x7fa6481f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64eb65640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6480cdda0 0x7fa6480ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 -- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6480cdda0 msgr2=0x7fa6480ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6480cdda0 0x7fa6480ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 -- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6481f3d70 msgr2=0x7fa6481f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6481f3d70 0x7fa6481f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 -- 172.21.15.43:0/830164415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64814cd90 con 0x7fa634004d40 2024-06-13T11:37:52.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa64e364640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa64814c850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa644011910 tx=0x7fa644011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64400faf0 con 0x7fa634004d40 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64400fc90 con 0x7fa634004d40 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa648158490 con 0x7fa634004d40 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644014440 con 0x7fa634004d40 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.971+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa648158a50 con 0x7fa634004d40 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.972+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa64804ffb0 con 0x7fa634004d40 2024-06-13T11:37:52.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.973+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa644012040 con 0x7fa634004d40 2024-06-13T11:37:52.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.973+0000 7fa63effd640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa62c06be30 0x7fa62c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:52.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.973+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fa64408b150 con 0x7fa634004d40 2024-06-13T11:37:52.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.974+0000 7fa64db63640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa62c06be30 0x7fa62c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:52.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.974+0000 7fa64db63640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa62c06be30 0x7fa62c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6480b07b0 tx=0x7fa638007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:52.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:52.978+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa644019030 con 0x7fa634004d40 2024-06-13T11:37:53.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.162+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa6481593f0 con 0x7fa634004d40 2024-06-13T11:37:53.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.162+0000 7fa63effd640 1 -- 172.21.15.43:0/830164415 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) ==== 84+0+65 (secure 0 0 0) 0x7fa644059700 con 0x7fa634004d40 2024-06-13T11:37:53.162 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:53.163 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-06-13T11:37:53.163 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-06-13T11:37:53.163 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-06-13T11:37:53.163 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-06-13T11:37:53.163 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-06-13T11:37:53.163 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-06-13T11:37:53.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa62c06be30 msgr2=0x7fa62c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:53.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa62c06be30 0x7fa62c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6480b07b0 tx=0x7fa638007970 comp rx=0 tx=0).stop 2024-06-13T11:37:53.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 msgr2=0x7fa64814c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa64814c850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa644011910 tx=0x7fa644011dd0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 shutdown_connections 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa62c06be30 0x7fa62c06e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa6480cdda0 0x7fa6480ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6481f3d70 0x7fa6481f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 --2- 172.21.15.43:0/830164415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa634004d40 0x7fa64814c850 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 >> 172.21.15.43:0/830164415 conn(0x7fa6480b14b0 msgr2=0x7fa6481604c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 shutdown_connections 2024-06-13T11:37:53.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.164+0000 7fa6505c8640 1 -- 172.21.15.43:0/830164415 wait complete. 2024-06-13T11:37:53.175 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-13T11:37:53.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-13T11:37:53.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.282+0000 7f56f3c6b640 1 Processor -- start 2024-06-13T11:37:53.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.282+0000 7f56f3c6b640 1 -- start start 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f3c6b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56ec13ef60 0x7f56ec072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f3c6b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56ec13f340 0x7f56ec072f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f3c6b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56ec06cff0 con 0x7f56ec06da90 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f3c6b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec15d730 con 0x7f56ec13ef60 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f3c6b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f56ec15d450 con 0x7f56ec13f340 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f2208640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f56ec06da90 0x7f56ec15c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37050/0 (socket says 172.21.15.43:37050) 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1a07640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56ec13ef60 0x7f56ec072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f2208640 1 -- 172.21.15.43:0/3126019922 learned_addr learned my addr 172.21.15.43:0/3126019922 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1206640 1 --2- 172.21.15.43:0/3126019922 >> v2:172.21.15.53:3300/0 conn(0x7f56ec13f340 0x7f56ec072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1a07640 1 -- 172.21.15.43:0/3126019922 >> v2:172.21.15.53:3300/0 conn(0x7f56ec13f340 msgr2=0x7f56ec072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1a07640 1 --2- 172.21.15.43:0/3126019922 >> v2:172.21.15.53:3300/0 conn(0x7f56ec13f340 0x7f56ec072f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1a07640 1 -- 172.21.15.43:0/3126019922 >> v1:172.21.15.43:6789/0 conn(0x7f56ec06da90 legacy=0x7f56ec15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1a07640 1 -- 172.21.15.43:0/3126019922 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec06d290 con 0x7f56ec13ef60 2024-06-13T11:37:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.283+0000 7f56f1206640 1 --2- 172.21.15.43:0/3126019922 >> v2:172.21.15.53:3300/0 conn(0x7f56ec13f340 0x7f56ec072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.284+0000 7f56f1a07640 1 --2- 172.21.15.43:0/3126019922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec13ef60 0x7f56ec072a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f56ec15fc60 tx=0x7f56e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29203d6ee2c23c92 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.284+0000 7f56f0a05640 1 -- 172.21.15.43:0/3126019922 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8037070 con 0x7f56ec13ef60 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.284+0000 7f56f0a05640 1 -- 172.21.15.43:0/3126019922 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8032440 con 0x7f56ec13ef60 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f0a05640 1 -- 172.21.15.43:0/3126019922 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8032810 con 0x7f56ec13ef60 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 -- 172.21.15.43:0/3126019922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec13ef60 msgr2=0x7f56ec072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/3126019922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec13ef60 0x7f56ec072a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f56ec15fc60 tx=0x7f56e802a1a0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 -- 172.21.15.43:0/3126019922 shutdown_connections 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/3126019922 >> v2:172.21.15.53:3300/0 conn(0x7f56ec13f340 0x7f56ec072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/3126019922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec13ef60 0x7f56ec072a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 -- 172.21.15.43:0/3126019922 >> 172.21.15.43:0/3126019922 conn(0x7f56ec067940 msgr2=0x7f56ec0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:53.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 -- 172.21.15.43:0/3126019922 shutdown_connections 2024-06-13T11:37:53.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.285+0000 7f56f3c6b640 1 -- 172.21.15.43:0/3126019922 wait complete. 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.286+0000 7f56f3c6b640 1 Processor -- start 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.286+0000 7f56f3c6b640 1 -- start start 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f3c6b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 0x7f56ec13da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f3c6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56ec13ef60 0x7f56ec0ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f3c6b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56ec13f340 0x7f56ec0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f3c6b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec15cfa0 con 0x7f56ec06da90 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f3c6b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec15ce20 con 0x7f56ec13ef60 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f3c6b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec15d120 con 0x7f56ec13f340 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f1a07640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 0x7f56ec13da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:53.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f1a07640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 0x7f56ec13da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54838/0 (socket says 172.21.15.43:54838) 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.287+0000 7f56f1a07640 1 -- 172.21.15.43:0/1725843733 learned_addr learned my addr 172.21.15.43:0/1725843733 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1206640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56ec13ef60 0x7f56ec0ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f2208640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56ec13f340 0x7f56ec0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1a07640 1 -- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56ec13f340 msgr2=0x7f56ec0ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1a07640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56ec13f340 0x7f56ec0ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1a07640 1 -- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56ec13ef60 msgr2=0x7f56ec0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1a07640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56ec13ef60 0x7f56ec0ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1a07640 1 -- 172.21.15.43:0/1725843733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec0709f0 con 0x7f56ec06da90 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f1a07640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 0x7f56ec13da00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8037040 con 0x7f56ec06da90 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8042070 con 0x7f56ec06da90 2024-06-13T11:37:53.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8030a50 con 0x7f56ec06da90 2024-06-13T11:37:53.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec070cd0 con 0x7f56ec06da90 2024-06-13T11:37:53.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.288+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec071290 con 0x7f56ec06da90 2024-06-13T11:37:53.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.289+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec04ffb0 con 0x7f56ec06da90 2024-06-13T11:37:53.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.290+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56e8030bf0 con 0x7f56ec06da90 2024-06-13T11:37:53.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.290+0000 7f56e27fc640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f56d006be30 0x7f56d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:53.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.290+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f56e80ab620 con 0x7f56ec06da90 2024-06-13T11:37:53.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.291+0000 7f56f1206640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f56d006be30 0x7f56d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:53.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.291+0000 7f56f1206640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f56d006be30 0x7f56d006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56ec15ae40 tx=0x7f56dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:53.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.295+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f56e8079b40 con 0x7f56ec06da90 2024-06-13T11:37:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:53.479+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f56ec06e690 con 0x7f56ec06da90 2024-06-13T11:37:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.292+0000 7f56e27fc640 1 -- 172.21.15.43:0/1725843733 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) ==== 138+0+0 (secure 0 0 0) 0x7f56e807de40 con 0x7f56ec06da90 2024-06-13T11:37:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-06-13T11:37:54.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.294+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f56d006be30 msgr2=0x7f56d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:54.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.294+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f56d006be30 0x7f56d006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56ec15ae40 tx=0x7f56dc008040 comp rx=0 tx=0).stop 2024-06-13T11:37:54.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.294+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 msgr2=0x7f56ec13da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:54.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.294+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 0x7f56ec13da00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56e8000c00 tx=0x7f56e80046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 shutdown_connections 2024-06-13T11:37:54.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f56d006be30 0x7f56d006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f56ec13f340 0x7f56ec0ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56ec13ef60 0x7f56ec0ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 --2- 172.21.15.43:0/1725843733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ec06da90 0x7f56ec13da00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 >> 172.21.15.43:0/1725843733 conn(0x7f56ec067940 msgr2=0x7f56ec072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:54.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 shutdown_connections 2024-06-13T11:37:54.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.295+0000 7f56f3c6b640 1 -- 172.21.15.43:0/1725843733 wait complete. 2024-06-13T11:37:54.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-13T11:37:54.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.427+0000 7fbbaa5d5640 1 Processor -- start 2024-06-13T11:37:54.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.427+0000 7fbbaa5d5640 1 -- start start 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbbaa5d5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 0x7fbba415c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbbaa5d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbba4160810 0x7fbba40aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbbaa5d5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba40cd7e0 con 0x7fbba4145b80 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbbaa5d5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbba40aabf0 con 0x7fbba4160810 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbbaa5d5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbba4160cc0 con 0x7fbba4070f60 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba3fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbba4145b80 0x7fbba4070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37056/0 (socket says 172.21.15.43:37056) 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba3fff640 1 -- 172.21.15.43:0/3435058195 learned_addr learned my addr 172.21.15.43:0/3435058195 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:54.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba8b72640 1 --2- 172.21.15.43:0/3435058195 >> v2:172.21.15.53:3300/0 conn(0x7fbba4160810 0x7fbba40aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba37fe640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 0x7fbba415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864696564 0 0) 0x7fbba40cd7e0 con 0x7fbba4145b80 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c003520 con 0x7fbba4145b80 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951164429 0 0) 0x7fbb8c003520 con 0x7fbba4145b80 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 msgr2=0x7fbba415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 0x7fbba415c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 >> v2:172.21.15.53:3300/0 conn(0x7fbba4160810 msgr2=0x7fbba40aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 --2- 172.21.15.43:0/3435058195 >> v2:172.21.15.53:3300/0 conn(0x7fbba4160810 0x7fbba40aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba40aae20 con 0x7fbba4145b80 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7fbb94001670 con 0x7fbba4145b80 2024-06-13T11:37:54.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 >> v1:172.21.15.43:6789/0 conn(0x7fbba4145b80 legacy=0x7fbba4070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 0x7fbb8c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb8c003f30 0x7fbb8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.428+0000 7fbba2ffd640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c004d40 0x7fbb8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbba4160cc0 con 0x7fbb8c003f30 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c00b9c0 con 0x7fbb8c004d40 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c00bb40 con 0x7fbba4070f60 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba37fe640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb8c003f30 0x7fbb8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba3fff640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 0x7fbb8c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba8b72640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c004d40 0x7fbb8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba37fe640 1 -- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 msgr2=0x7fbb8c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba37fe640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4070f60 0x7fbb8c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba37fe640 1 -- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c004d40 msgr2=0x7fbb8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:54.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba37fe640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c004d40 0x7fbb8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.429+0000 7fbba37fe640 1 -- 172.21.15.43:0/3435058195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c003520 con 0x7fbb8c003f30 2024-06-13T11:37:54.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbba37fe640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb8c003f30 0x7fbb8c004800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009ac0 tx=0x7fbb8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb75816b3134ed96 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:54.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98036070 con 0x7fbb8c003f30 2024-06-13T11:37:54.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb98031400 con 0x7fbb8c003f30 2024-06-13T11:37:54.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbba2ffd640 1 -- 172.21.15.43:0/3435058195 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98009690 con 0x7fbb8c003f30 2024-06-13T11:37:54.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/3435058195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb8c003f30 msgr2=0x7fbb8c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:54.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/3435058195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb8c003f30 0x7fbb8c004800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009ac0 tx=0x7fbb8c005830 comp rx=0 tx=0).stop 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbba8b72640 1 -- 172.21.15.43:0/3435058195 reap_dead start 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/3435058195 shutdown_connections 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/3435058195 >> 172.21.15.43:0/3435058195 conn(0x7fbba406c250 msgr2=0x7fbba4067220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/3435058195 shutdown_connections 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.430+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/3435058195 wait complete. 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.431+0000 7fbbaa5d5640 1 Processor -- start 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 -- start start 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c003f30 0x7fbba40cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4140a80 0x7fbba4140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 0x7fbba413ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbba40ab6c0 con 0x7fbba413b5b0 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbba40ab3e0 con 0x7fbb8c003f30 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.432+0000 7fbbaa5d5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fbba4145f60 con 0x7fbba4140a80 2024-06-13T11:37:54.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 0x7fbba413ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 0x7fbba413ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54856/0 (socket says 172.21.15.43:54856) 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 -- 172.21.15.43:0/2510930196 learned_addr learned my addr 172.21.15.43:0/2510930196 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba3fff640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c003f30 0x7fbba40cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba37fe640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4140a80 0x7fbba4140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 -- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4140a80 msgr2=0x7fbba4140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4140a80 0x7fbba4140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 -- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c003f30 msgr2=0x7fbba40cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c003f30 0x7fbba40cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 -- 172.21.15.43:0/2510930196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba413bf50 con 0x7fbba413b5b0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba8b72640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 0x7fbba413ba10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbba406f530 tx=0x7fbb9c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00fce0 con 0x7fbba413b5b0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c01d070 con 0x7fbba413b5b0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba41414d0 con 0x7fbba413b5b0 2024-06-13T11:37:54.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c015670 con 0x7fbba413b5b0 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.433+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba4141a90 con 0x7fbba413b5b0 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.434+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba40688c0 con 0x7fbba413b5b0 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.435+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb9c015810 con 0x7fbba413b5b0 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.435+0000 7fbba0ff9640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbb9006be30 0x7fbb9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.435+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5619+0+0 (secure 0 0 0) 0x7fbb9c08b700 con 0x7fbba413b5b0 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.436+0000 7fbba3fff640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbb9006be30 0x7fbb9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:54.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.436+0000 7fbba3fff640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbb9006be30 0x7fbb9006e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb94001050 tx=0x7fbb94007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:54.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.440+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb9c010040 con 0x7fbba413b5b0 2024-06-13T11:37:54.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:54.627+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbba404ffb0 con 0x7fbba413b5b0 2024-06-13T11:37:55.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.294+0000 7fbba0ff9640 1 -- 172.21.15.43:0/2510930196 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) ==== 170+0+0 (secure 0 0 0) 0x7fbb9c05a060 con 0x7fbba413b5b0 2024-06-13T11:37:55.294 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-06-13T11:37:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbb9006be30 msgr2=0x7fbb9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbb9006be30 0x7fbb9006e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb94001050 tx=0x7fbb94007970 comp rx=0 tx=0).stop 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 msgr2=0x7fbba413ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 0x7fbba413ba10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbba406f530 tx=0x7fbb9c00f1b0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 shutdown_connections 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fbb9006be30 0x7fbb9006e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbba413b5b0 0x7fbba413ba10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fbba4140a80 0x7fbba4140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 --2- 172.21.15.43:0/2510930196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c003f30 0x7fbba40cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 >> 172.21.15.43:0/2510930196 conn(0x7fbba406c250 msgr2=0x7fbba4067220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 shutdown_connections 2024-06-13T11:37:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.297+0000 7fbbaa5d5640 1 -- 172.21.15.43:0/2510930196 wait complete. 2024-06-13T11:37:55.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-13T11:37:55.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.434+0000 7fee00b3b640 1 Processor -- start 2024-06-13T11:37:55.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.434+0000 7fee00b3b640 1 -- start start 2024-06-13T11:37:55.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.435+0000 7fee00b3b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc15e950 0x7fedfc0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:55.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.435+0000 7fee00b3b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedfc0d2110 con 0x7fedfc0cf4c0 2024-06-13T11:37:55.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.435+0000 7fee00b3b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedfc071cd0 con 0x7fedfc0d1d30 2024-06-13T11:37:55.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.435+0000 7fee00b3b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc072d70 con 0x7fedfc15e950 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.435+0000 7fedf9d9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fedfc0cf4c0 0x7fedfc0d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37058/0 (socket says 172.21.15.43:37058) 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.435+0000 7fedf9d9b640 1 -- 172.21.15.43:0/2659047426 learned_addr learned my addr 172.21.15.43:0/2659047426 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedfad9d640 1 --2- 172.21.15.43:0/2659047426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc15e950 0x7fedfc0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207074224 0 0) 0x7fedfc0d2110 con 0x7fedfc0cf4c0 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede8003520 con 0x7fedfc0cf4c0 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881594132 0 0) 0x7fedfc071cd0 con 0x7fedfc0d1d30 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedfc0d2110 con 0x7fedfc0d1d30 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedfad9d640 1 -- 172.21.15.43:0/2659047426 >> v1:172.21.15.53:6789/0 conn(0x7fedfc0d1d30 legacy=0x7fedfc0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3914882839 0 0) 0x7fede8003520 con 0x7fedfc0cf4c0 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedfad9d640 1 -- 172.21.15.43:0/2659047426 >> v1:172.21.15.43:6789/0 conn(0x7fedfc0cf4c0 legacy=0x7fedfc0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.436+0000 7fedfad9d640 1 -- 172.21.15.43:0/2659047426 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc071fb0 con 0x7fedfc15e950 2024-06-13T11:37:55.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.437+0000 7fedfad9d640 1 --2- 172.21.15.43:0/2659047426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc15e950 0x7fedfc0715d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fedec009dc0 tx=0x7fedec02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=597d5ef605d6b780 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:55.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.437+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4001670 con 0x7fedfc15e950 2024-06-13T11:37:55.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.437+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec007540 con 0x7fedfc15e950 2024-06-13T11:37:55.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.437+0000 7fedf959a640 1 -- 172.21.15.43:0/2659047426 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0078f0 con 0x7fedfc15e950 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 -- 172.21.15.43:0/2659047426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc15e950 msgr2=0x7fedfc0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 --2- 172.21.15.43:0/2659047426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc15e950 0x7fedfc0715d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fedec009dc0 tx=0x7fedec02a660 comp rx=0 tx=0).stop 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 -- 172.21.15.43:0/2659047426 shutdown_connections 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 --2- 172.21.15.43:0/2659047426 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc15e950 0x7fedfc0715d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 -- 172.21.15.43:0/2659047426 >> 172.21.15.43:0/2659047426 conn(0x7fedfc06cb10 msgr2=0x7fedfc06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 -- 172.21.15.43:0/2659047426 shutdown_connections 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.438+0000 7fee00b3b640 1 -- 172.21.15.43:0/2659047426 wait complete. 2024-06-13T11:37:55.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.439+0000 7fee00b3b640 1 Processor -- start 2024-06-13T11:37:55.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.439+0000 7fee00b3b640 1 -- start start 2024-06-13T11:37:55.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fee00b3b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc0cf4c0 0x7fedfc154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:55.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fee00b3b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc0d1d30 0x7fedfc1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:55.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fee00b3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 0x7fedfc1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:55.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fee00b3b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc072570 con 0x7fedfc15e950 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fee00b3b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc072850 con 0x7fedfc0d1d30 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fee00b3b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fedfc0d0930 con 0x7fedfc0cf4c0 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 0x7fedfc1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 0x7fedfc1517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54868/0 (socket says 172.21.15.43:54868) 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 -- 172.21.15.43:0/1502503597 learned_addr learned my addr 172.21.15.43:0/1502503597 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfa59c640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc0cf4c0 0x7fedfc154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedf9d9b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc0d1d30 0x7fedfc1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 -- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc0cf4c0 msgr2=0x7fedfc154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc0cf4c0 0x7fedfc154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 -- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc0d1d30 msgr2=0x7fedfc1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc0d1d30 0x7fedfc1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.440+0000 7fedfad9d640 1 -- 172.21.15.43:0/1502503597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc150700 con 0x7fedfc15e950 2024-06-13T11:37:55.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.441+0000 7fedfad9d640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 0x7fedfc1517a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fedec009ee0 tx=0x7fedec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:55.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.441+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec03f070 con 0x7fedfc15e950 2024-06-13T11:37:55.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.441+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec031c40 con 0x7fedfc15e950 2024-06-13T11:37:55.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.441+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc1509e0 con 0x7fedfc15e950 2024-06-13T11:37:55.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.441+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec009450 con 0x7fedfc15e950 2024-06-13T11:37:55.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.441+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc150fa0 con 0x7fedfc15e950 2024-06-13T11:37:55.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.442+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedfc04ffb0 con 0x7fedfc15e950 2024-06-13T11:37:55.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.442+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedec043410 con 0x7fedfc15e950 2024-06-13T11:37:55.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.443+0000 7fedf2ffd640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7feddc06be60 0x7feddc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:55.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.443+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6001+0+0 (secure 0 0 0) 0x7fedec0ac040 con 0x7fedfc15e950 2024-06-13T11:37:55.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.443+0000 7fedfa59c640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7feddc06be60 0x7feddc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:55.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.443+0000 7fedfa59c640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7feddc06be60 0x7feddc06e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedf40011e0 tx=0x7fedf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:55.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.447+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fedec07a300 con 0x7fedfc15e950 2024-06-13T11:37:55.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:55.671+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fedfc06d940 con 0x7fedfc15e950 2024-06-13T11:37:56.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.302+0000 7fedf2ffd640 1 -- 172.21.15.43:0/1502503597 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fedec07e600 con 0x7fedfc15e950 2024-06-13T11:37:56.302 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 5 and data pool 6 2024-06-13T11:37:56.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7feddc06be60 msgr2=0x7feddc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7feddc06be60 0x7feddc06e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedf40011e0 tx=0x7fedf4009040 comp rx=0 tx=0).stop 2024-06-13T11:37:56.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 msgr2=0x7fedfc1517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 0x7fedfc1517a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fedec009ee0 tx=0x7fedec004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 shutdown_connections 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7feddc06be60 0x7feddc06e320 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedf40011e0 tx=0x7fedf4009040 comp rx=0 tx=0).stop 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedfc15e950 0x7fedfc1517a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc0d1d30 0x7fedfc1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 --2- 172.21.15.43:0/1502503597 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fedfc0cf4c0 0x7fedfc154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.307+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 >> 172.21.15.43:0/1502503597 conn(0x7fedfc06cb10 msgr2=0x7fedfc160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:56.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.308+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 shutdown_connections 2024-06-13T11:37:56.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.309+0000 7fee00b3b640 1 -- 172.21.15.43:0/1502503597 wait complete. 2024-06-13T11:37:56.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:56.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.452+0000 7f16c97a5640 1 Processor -- start 2024-06-13T11:37:56.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.452+0000 7f16c97a5640 1 -- start start 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c97a5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4144d40 0x7f16c40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c97a5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f16c4072f40 0x7f16c40d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c97a5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c4071ea0 con 0x7f16c40d0dd0 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c97a5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f16c4072180 con 0x7f16c4072f40 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c97a5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f16c4072460 con 0x7f16c4144d40 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c27fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f16c4072f40 0x7f16c40d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c37fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f16c40d0dd0 0x7f16c4145530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37074/0 (socket says 172.21.15.43:37074) 2024-06-13T11:37:56.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c37fe640 1 -- 172.21.15.43:0/753850969 learned_addr learned my addr 172.21.15.43:0/753850969 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:56.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.453+0000 7f16c2ffd640 1 --2- 172.21.15.43:0/753850969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4144d40 0x7f16c40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.454+0000 7f16c27fc640 1 -- 172.21.15.43:0/753850969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4144d40 msgr2=0x7f16c40718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:56.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.454+0000 7f16c27fc640 1 --2- 172.21.15.43:0/753850969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4144d40 0x7f16c40718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.454+0000 7f16c27fc640 1 -- 172.21.15.43:0/753850969 >> v1:172.21.15.43:6789/0 conn(0x7f16c40d0dd0 legacy=0x7f16c4145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.454+0000 7f16c27fc640 1 -- 172.21.15.43:0/753850969 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c4072740 con 0x7f16c4072f40 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.454+0000 7f16c27fc640 1 --2- 172.21.15.43:0/753850969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c4072f40 0x7f16c40d0070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f16b80097a0 tx=0x7f16b802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1a2caa4480671 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.454+0000 7f16c1ffb640 1 -- 172.21.15.43:0/753850969 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8037070 con 0x7f16c4072f40 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c1ffb640 1 -- 172.21.15.43:0/753850969 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8032440 con 0x7f16c4072f40 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c1ffb640 1 -- 172.21.15.43:0/753850969 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8032810 con 0x7f16c4072f40 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 -- 172.21.15.43:0/753850969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c4072f40 msgr2=0x7f16c40d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 --2- 172.21.15.43:0/753850969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c4072f40 0x7f16c40d0070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f16b80097a0 tx=0x7f16b802a180 comp rx=0 tx=0).stop 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 -- 172.21.15.43:0/753850969 shutdown_connections 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 --2- 172.21.15.43:0/753850969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c4072f40 0x7f16c40d0070 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 --2- 172.21.15.43:0/753850969 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4144d40 0x7f16c40718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 -- 172.21.15.43:0/753850969 >> 172.21.15.43:0/753850969 conn(0x7f16c4070810 msgr2=0x7f16c4070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:56.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 -- 172.21.15.43:0/753850969 shutdown_connections 2024-06-13T11:37:56.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.455+0000 7f16c97a5640 1 -- 172.21.15.43:0/753850969 wait complete. 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.456+0000 7f16c97a5640 1 Processor -- start 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 -- start start 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4072f40 0x7f16c41f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 0x7f16c4161e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c4144d40 0x7f16c4162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16c4145120 con 0x7f16c40d0dd0 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40d05b0 con 0x7f16c4144d40 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c97a5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40ae4a0 con 0x7f16c4072f40 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c27fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 0x7f16c4161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c27fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 0x7f16c4161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54892/0 (socket says 172.21.15.43:54892) 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c27fc640 1 -- 172.21.15.43:0/1685025356 learned_addr learned my addr 172.21.15.43:0/1685025356 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:56.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c37fe640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c4144d40 0x7f16c4162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.457+0000 7f16c2ffd640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4072f40 0x7f16c41f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c27fc640 1 -- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4072f40 msgr2=0x7f16c41f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c27fc640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4072f40 0x7f16c41f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c27fc640 1 -- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c4144d40 msgr2=0x7f16c4162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c27fc640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c4144d40 0x7f16c4162370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c27fc640 1 -- 172.21.15.43:0/1685025356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c41f7610 con 0x7f16c40d0dd0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c2ffd640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4072f40 0x7f16c41f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c27fc640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 0x7f16c4161e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f16b80098c0 tx=0x7f16b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8037040 con 0x7f16c40d0dd0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8030770 con 0x7f16c40d0dd0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c41f6d70 con 0x7f16c40d0dd0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8030b40 con 0x7f16c40d0dd0 2024-06-13T11:37:56.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.458+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c41f7330 con 0x7f16c40d0dd0 2024-06-13T11:37:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.459+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c404ffb0 con 0x7f16c40d0dd0 2024-06-13T11:37:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.460+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16b8044020 con 0x7f16c40d0dd0 2024-06-13T11:37:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.460+0000 7f16ab7fe640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f16b006be30 0x7f16b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.460+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f16b80ab410 con 0x7f16c40d0dd0 2024-06-13T11:37:56.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.460+0000 7f16c2ffd640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f16b006be30 0x7f16b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.461+0000 7f16c2ffd640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f16b006be30 0x7f16b006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16b4006fd0 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:56.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.465+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f16b8032e20 con 0x7f16c40d0dd0 2024-06-13T11:37:56.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.652+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16c413e160 con 0x7f16c40d0dd0 2024-06-13T11:37:56.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.654+0000 7f16ab7fe640 1 -- 172.21.15.43:0/1685025356 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16895 (secure 0 0 0) 0x7f16b8079c30 con 0x7f16c40d0dd0 2024-06-13T11:37:56.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:56.653 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":36,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:55.673185+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:53.511526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:54.658987+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:56.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f16b006be30 msgr2=0x7f16b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f16b006be30 0x7f16b006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16b4006fd0 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 msgr2=0x7f16c4161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 0x7f16c4161e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f16b80098c0 tx=0x7f16b80046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 shutdown_connections 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f16b006be30 0x7f16b006e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c4144d40 0x7f16c4162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16c40d0dd0 0x7f16c4161e30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 --2- 172.21.15.43:0/1685025356 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f16c4072f40 0x7f16c41f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 >> 172.21.15.43:0/1685025356 conn(0x7f16c4070810 msgr2=0x7f16c41419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 shutdown_connections 2024-06-13T11:37:56.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.656+0000 7f16c97a5640 1 -- 172.21.15.43:0/1685025356 wait complete. 2024-06-13T11:37:56.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:56.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.771+0000 7f8807025640 1 Processor -- start 2024-06-13T11:37:56.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.771+0000 7f8807025640 1 -- start start 2024-06-13T11:37:56.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f8807025640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f880015c250 0x7f8800071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f8807025640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f88000a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f8807025640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88000b09f0 con 0x7f8800072b90 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f8807025640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8800072700 con 0x7f880015c250 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f8807025640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8800071dd0 con 0x7f88000cf580 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f87fffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8800072b90 0x7f88000cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37086/0 (socket says 172.21.15.43:37086) 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f87fffff640 1 -- 172.21.15.43:0/1171293847 learned_addr learned my addr 172.21.15.43:0/1171293847 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f88055c2640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f88000a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011189519 0 0) 0x7f88000b09f0 con 0x7f8800072b90 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f8804dc1640 1 --2- 172.21.15.43:0/1171293847 >> v2:172.21.15.53:3300/0 conn(0x7f880015c250 0x7f8800071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.772+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87ec003520 con 0x7f8800072b90 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 457720422 0 0) 0x7f87ec003520 con 0x7f8800072b90 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 msgr2=0x7f88000a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f88000a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 >> v2:172.21.15.53:3300/0 conn(0x7f880015c250 msgr2=0x7f8800071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:56.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 --2- 172.21.15.43:0/1171293847 >> v2:172.21.15.53:3300/0 conn(0x7f880015c250 0x7f8800071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88000720b0 con 0x7f8800072b90 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f87e8001670 con 0x7f8800072b90 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 >> v1:172.21.15.43:6789/0 conn(0x7f8800072b90 legacy=0x7f88000cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f87ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ec004800 0x7f87ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f87ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8800072700 con 0x7f87ec0039b0 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8800071dd0 con 0x7f87ec004800 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f87ec00b9c0 con 0x7f88000cf580 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f8804dc1640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f87ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f87fffff640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ec004800 0x7f87ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f88055c2640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f87ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f8804dc1640 1 -- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 msgr2=0x7f87ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f8804dc1640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f87ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f8804dc1640 1 -- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ec004800 msgr2=0x7f87ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f8804dc1640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ec004800 0x7f87ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f8804dc1640 1 -- 172.21.15.43:0/1171293847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec003520 con 0x7f87ec0039b0 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.773+0000 7f88055c2640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f88000cf580 0x7f87ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.774+0000 7f8804dc1640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f87ec003dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009fc0 tx=0x7f87ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53aa0ea7b4a990fb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.774+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0009c10 con 0x7f87ec0039b0 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.774+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0036070 con 0x7f87ec0039b0 2024-06-13T11:37:56.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.774+0000 7f87ff7fe640 1 -- 172.21.15.43:0/1171293847 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f002d070 con 0x7f87ec0039b0 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f8807025640 1 -- 172.21.15.43:0/1171293847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 msgr2=0x7f87ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f8807025640 1 --2- 172.21.15.43:0/1171293847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f87ec003dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009fc0 tx=0x7f87ec005830 comp rx=0 tx=0).stop 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f88055c2640 1 -- 172.21.15.43:0/1171293847 reap_dead start 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f8807025640 1 -- 172.21.15.43:0/1171293847 shutdown_connections 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f8807025640 1 -- 172.21.15.43:0/1171293847 >> 172.21.15.43:0/1171293847 conn(0x7f88000b14b0 msgr2=0x7f88000b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f8807025640 1 -- 172.21.15.43:0/1171293847 shutdown_connections 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.775+0000 7f8807025640 1 -- 172.21.15.43:0/1171293847 wait complete. 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.776+0000 7f8807025640 1 Processor -- start 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.776+0000 7f8807025640 1 -- start start 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8807025640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f88000ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8807025640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f880015ac80 0x7f8800146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8807025640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88000ac880 0x7f88000c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8807025640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f880015c7b0 con 0x7f87ec0039b0 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8807025640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f880015c630 con 0x7f88000ac880 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8807025640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f88000b0e30 con 0x7f880015ac80 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f88000ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f88000ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54906/0 (socket says 172.21.15.43:54906) 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 -- 172.21.15.43:0/2343853279 learned_addr learned my addr 172.21.15.43:0/2343853279 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 -- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f880015ac80 msgr2=0x7f8800146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f87fffff640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f880015ac80 0x7f8800146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f880015ac80 0x7f8800146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 -- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88000ac880 msgr2=0x7f88000c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f88055c2640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88000ac880 0x7f88000c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88000ac880 0x7f88000c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.777+0000 7f8804dc1640 1 -- 172.21.15.43:0/2343853279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8800147770 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.778+0000 7f8804dc1640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f88000ad550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87f002af10 tx=0x7f87f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.778+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0009c10 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.778+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0003bb0 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.778+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0004020 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.778+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8800147a50 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.778+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8800148010 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.779+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88000aa910 con 0x7f87ec0039b0 2024-06-13T11:37:56.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.779+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87f0005d10 con 0x7f87ec0039b0 2024-06-13T11:37:56.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.780+0000 7f87fd7fa640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f87e006be30 0x7f87e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:56.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.780+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f87f00ac590 con 0x7f87ec0039b0 2024-06-13T11:37:56.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.780+0000 7f87fffff640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f87e006be30 0x7f87e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:56.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.781+0000 7f87fffff640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f87e006be30 0x7f87e006e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f87e8000c00 tx=0x7f87e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:56.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.784+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f88000aa910 con 0x7f87ec0039b0 2024-06-13T11:37:56.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.972+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f880004ffb0 con 0x7f87ec0039b0 2024-06-13T11:37:56.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.973+0000 7f87fd7fa640 1 -- 172.21.15.43:0/2343853279 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16895 (secure 0 0 0) 0x7f87f007ac80 con 0x7f87ec0039b0 2024-06-13T11:37:56.973 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:56.973 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":36,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:55.673185+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:53.511526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:54.658987+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f87e006be30 msgr2=0x7f87e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f87e006be30 0x7f87e006e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f87e8000c00 tx=0x7f87e8009040 comp rx=0 tx=0).stop 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 msgr2=0x7f88000ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f88000ad550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f87f002af10 tx=0x7f87f0009750 comp rx=0 tx=0).stop 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 shutdown_connections 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f87e006be30 0x7f87e006e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88000ac880 0x7f88000c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f880015ac80 0x7f8800146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 --2- 172.21.15.43:0/2343853279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87ec0039b0 0x7f88000ad550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:56.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 >> 172.21.15.43:0/2343853279 conn(0x7f88000b14b0 msgr2=0x7f8800070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:56.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 shutdown_connections 2024-06-13T11:37:56.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:56.975+0000 7f8807025640 1 -- 172.21.15.43:0/2343853279 wait complete. 2024-06-13T11:37:56.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-13T11:37:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.093+0000 7fe3df86b640 1 Processor -- start 2024-06-13T11:37:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.093+0000 7fe3df86b640 1 -- start start 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.094+0000 7fe3df86b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3d815e460 0x7fe3d80aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.094+0000 7fe3df86b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3d80ae200 0x7fe3d80ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.094+0000 7fe3df86b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d80d3630 con 0x7fe3d80d15c0 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.094+0000 7fe3df86b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d80d3910 con 0x7fe3d815e460 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.094+0000 7fe3df86b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d80d3bf0 con 0x7fe3d80ae200 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.094+0000 7fe3dd607640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3d815e460 0x7fe3d80aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe3d815e460 0x7fe3d80aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54912/0 (socket says 172.21.15.43:54912) 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 -- 172.21.15.43:0/721982661 learned_addr learned my addr 172.21.15.43:0/721982661 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dce06640 1 --2- 172.21.15.43:0/721982661 >> v2:172.21.15.53:3300/0 conn(0x7fe3d80ae200 0x7fe3d80ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 -- 172.21.15.43:0/721982661 >> v2:172.21.15.53:3300/0 conn(0x7fe3d80ae200 msgr2=0x7fe3d80ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 --2- 172.21.15.43:0/721982661 >> v2:172.21.15.53:3300/0 conn(0x7fe3d80ae200 0x7fe3d80ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 -- 172.21.15.43:0/721982661 >> v1:172.21.15.53:6789/0 conn(0x7fe3d80d15c0 legacy=0x7fe3d81621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 -- 172.21.15.43:0/721982661 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80d3ed0 con 0x7fe3d815e460 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.095+0000 7fe3dd607640 1 --2- 172.21.15.43:0/721982661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d815e460 0x7fe3d80aff80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8161d90 tx=0x7fe3c802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7a3ce4fc8082c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3d7fff640 1 -- 172.21.15.43:0/721982661 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8036070 con 0x7fe3d815e460 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3d7fff640 1 -- 172.21.15.43:0/721982661 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8031600 con 0x7fe3d815e460 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3d7fff640 1 -- 172.21.15.43:0/721982661 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80319d0 con 0x7fe3d815e460 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 -- 172.21.15.43:0/721982661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d815e460 msgr2=0x7fe3d80aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 --2- 172.21.15.43:0/721982661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d815e460 0x7fe3d80aff80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8161d90 tx=0x7fe3c802a660 comp rx=0 tx=0).stop 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 -- 172.21.15.43:0/721982661 shutdown_connections 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 --2- 172.21.15.43:0/721982661 >> v2:172.21.15.53:3300/0 conn(0x7fe3d80ae200 0x7fe3d80ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 --2- 172.21.15.43:0/721982661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d815e460 0x7fe3d80aff80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 -- 172.21.15.43:0/721982661 >> 172.21.15.43:0/721982661 conn(0x7fe3d80673d0 msgr2=0x7fe3d80d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:57.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 -- 172.21.15.43:0/721982661 shutdown_connections 2024-06-13T11:37:57.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.096+0000 7fe3df86b640 1 -- 172.21.15.43:0/721982661 wait complete. 2024-06-13T11:37:57.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.097+0000 7fe3df86b640 1 Processor -- start 2024-06-13T11:37:57.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.097+0000 7fe3df86b640 1 -- start start 2024-06-13T11:37:57.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3df86b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 0x7fe3d8150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3df86b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3d80d15c0 0x7fe3d8154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3df86b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d815e460 0x7fe3d8146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3df86b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80d1a30 con 0x7fe3d80ae200 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3df86b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80d32c0 con 0x7fe3d815e460 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3df86b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d80d1bb0 con 0x7fe3d80d15c0 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3dd607640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 0x7fe3d8150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3dd607640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 0x7fe3d8150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54914/0 (socket says 172.21.15.43:54914) 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.098+0000 7fe3dd607640 1 -- 172.21.15.43:0/775806952 learned_addr learned my addr 172.21.15.43:0/775806952 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dd607640 1 -- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3d80d15c0 msgr2=0x7fe3d8154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dd607640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3d80d15c0 0x7fe3d8154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dd607640 1 -- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d815e460 msgr2=0x7fe3d8146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dde08640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d815e460 0x7fe3d8146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dd607640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d815e460 0x7fe3d8146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dd607640 1 -- 172.21.15.43:0/775806952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d8147060 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dde08640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d815e460 0x7fe3d8146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3dd607640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 0x7fe3d8150010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034040 tx=0x7fe3c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8036050 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8042070 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d81549b0 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8009510 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.099+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d8154f70 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.100+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d804ffb0 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.101+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3c8007c50 con 0x7fe3d80ae200 2024-06-13T11:37:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.101+0000 7fe3d5ffb640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe3c406be30 0x7fe3c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:57.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.101+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fe3c80abe90 con 0x7fe3d80ae200 2024-06-13T11:37:57.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.101+0000 7fe3dce06640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe3c406be30 0x7fe3c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:57.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.102+0000 7fe3dce06640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe3c406be30 0x7fe3c406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ae810 tx=0x7fe3cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:57.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.106+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe3c807a740 con 0x7fe3d80ae200 2024-06-13T11:37:57.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:57.330+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe3d80ab700 con 0x7fe3d80ae200 2024-06-13T11:37:58.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.320+0000 7fe3d5ffb640 1 -- 172.21.15.43:0/775806952 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fe3c807a040 con 0x7fe3d80ae200 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe3c406be30 msgr2=0x7fe3c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe3c406be30 0x7fe3c406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ae810 tx=0x7fe3cc008040 comp rx=0 tx=0).stop 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 msgr2=0x7fe3d8150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 0x7fe3d8150010 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034040 tx=0x7fe3c8004a40 comp rx=0 tx=0).stop 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 shutdown_connections 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fe3c406be30 0x7fe3c406e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d815e460 0x7fe3d8146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fe3d80d15c0 0x7fe3d8154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 --2- 172.21.15.43:0/775806952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3d80ae200 0x7fe3d8150010 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 >> 172.21.15.43:0/775806952 conn(0x7fe3d80673d0 msgr2=0x7fe3d80abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 shutdown_connections 2024-06-13T11:37:58.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.323+0000 7fe3df86b640 1 -- 172.21.15.43:0/775806952 wait complete. 2024-06-13T11:37:58.336 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-13T11:37:58.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-13T11:37:58.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.450+0000 7f8c0fd61640 1 Processor -- start 2024-06-13T11:37:58.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.450+0000 7f8c0fd61640 1 -- start start 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0fd61640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c0806baa0 0x7f8c08162920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0fd61640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c080d1110 0x7f8c080d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0fd61640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c08144920 con 0x7f8c08141360 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0fd61640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8c08143da0 con 0x7f8c080d1110 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0fd61640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8c08144080 con 0x7f8c0806baa0 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0dafd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8c08141360 0x7f8c0806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37096/0 (socket says 172.21.15.43:37096) 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0dafd640 1 -- 172.21.15.43:0/3565110881 learned_addr learned my addr 172.21.15.43:0/3565110881 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0e2fe640 1 --2- 172.21.15.43:0/3565110881 >> v2:172.21.15.53:3300/0 conn(0x7f8c080d1110 0x7f8c080d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0d2fc640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c0806baa0 0x7f8c08162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:58.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0cafb640 1 -- 172.21.15.43:0/3565110881 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389303689 0 0) 0x7f8c08144920 con 0x7f8c08141360 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0cafb640 1 -- 172.21.15.43:0/3565110881 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bf4003520 con 0x7f8c08141360 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0e2fe640 1 -- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c0806baa0 msgr2=0x7f8c08162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0cafb640 1 -- 172.21.15.43:0/3565110881 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 919452526 0 0) 0x7f8bf4003520 con 0x7f8c08141360 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0e2fe640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c0806baa0 0x7f8c08162920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0e2fe640 1 -- 172.21.15.43:0/3565110881 >> v1:172.21.15.43:6789/0 conn(0x7f8c08141360 legacy=0x7f8c0806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0e2fe640 1 -- 172.21.15.43:0/3565110881 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c08144360 con 0x7f8c080d1110 2024-06-13T11:37:58.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.451+0000 7f8c0d2fc640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c0806baa0 0x7f8c08162920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.452+0000 7f8c0e2fe640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 0x7f8c080d15c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009d90 tx=0x7f8c0002a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c215ad9d3564ea server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.452+0000 7f8c0cafb640 1 -- 172.21.15.43:0/3565110881 <== mon.1 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04001670 con 0x7f8c080d1110 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.452+0000 7f8c0cafb640 1 -- 172.21.15.43:0/3565110881 <== mon.1 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00007540 con 0x7f8c080d1110 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.452+0000 7f8c0cafb640 1 -- 172.21.15.43:0/3565110881 <== mon.1 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c000078f0 con 0x7f8c080d1110 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 msgr2=0x7f8c080d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 0x7f8c080d15c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009d90 tx=0x7f8c0002a560 comp rx=0 tx=0).stop 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3565110881 shutdown_connections 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 0x7f8c080d15c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3565110881 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c0806baa0 0x7f8c08162920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3565110881 >> 172.21.15.43:0/3565110881 conn(0x7f8c08070810 msgr2=0x7f8c08070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:58.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3565110881 shutdown_connections 2024-06-13T11:37:58.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.453+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3565110881 wait complete. 2024-06-13T11:37:58.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.454+0000 7f8c0fd61640 1 Processor -- start 2024-06-13T11:37:58.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.454+0000 7f8c0fd61640 1 -- start start 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0fd61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 0x7f8c08160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0fd61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 0x7f8c081f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0fd61640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c08141360 0x7f8c0806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0fd61640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c080d0810 con 0x7f8c0806baa0 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0fd61640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8c08071300 con 0x7f8c080d1110 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0fd61640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f8c08143a00 con 0x7f8c08141360 2024-06-13T11:37:58.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 0x7f8c08160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 0x7f8c08160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54926/0 (socket says 172.21.15.43:54926) 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 -- 172.21.15.43:0/3360691509 learned_addr learned my addr 172.21.15.43:0/3360691509 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 -- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c08141360 msgr2=0x7f8c0806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c08141360 0x7f8c0806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 -- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 msgr2=0x7f8c081f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 0x7f8c081f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.455+0000 7f8c0dafd640 1 -- 172.21.15.43:0/3360691509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c081612d0 con 0x7f8c0806baa0 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.456+0000 7f8c0dafd640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 0x7f8c08160810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c7b0 tx=0x7f8c0400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.456+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04017070 con 0x7f8c0806baa0 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.456+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c04005af0 con 0x7f8c0806baa0 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.456+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04007070 con 0x7f8c0806baa0 2024-06-13T11:37:58.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.456+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c081f7780 con 0x7f8c0806baa0 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.456+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c081f8260 con 0x7f8c0806baa0 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.457+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0804ffb0 con 0x7f8c0806baa0 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.457+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c0401a070 con 0x7f8c0806baa0 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.458+0000 7f8bfe7fc640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8bec06be30 0x7f8bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.458+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f8c0408a550 con 0x7f8c0806baa0 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.458+0000 7f8c0d2fc640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8bec06be30 0x7f8bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:58.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.458+0000 7f8c0d2fc640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8bec06be30 0x7f8bec06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8006e80 tx=0x7f8bf8006dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:58.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.462+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c04058d70 con 0x7f8c0806baa0 2024-06-13T11:37:58.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:58.684+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8c0815bdf0 con 0x7f8c0806baa0 2024-06-13T11:37:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.325+0000 7f8bfe7fc640 1 -- 172.21.15.43:0/3360691509 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f8c04058670 con 0x7f8c0806baa0 2024-06-13T11:37:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8bec06be30 msgr2=0x7f8bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8bec06be30 0x7f8bec06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8006e80 tx=0x7f8bf8006dd0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 msgr2=0x7f8c08160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 0x7f8c08160810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c7b0 tx=0x7f8c0400cc70 comp rx=0 tx=0).stop 2024-06-13T11:37:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 shutdown_connections 2024-06-13T11:37:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f8bec06be30 0x7f8bec06e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f8c08141360 0x7f8c0806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c080d1110 0x7f8c081f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 --2- 172.21.15.43:0/3360691509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0806baa0 0x7f8c08160810 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.327+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 >> 172.21.15.43:0/3360691509 conn(0x7f8c08070810 msgr2=0x7f8c08070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.328+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 shutdown_connections 2024-06-13T11:37:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.328+0000 7f8c0fd61640 1 -- 172.21.15.43:0/3360691509 wait complete. 2024-06-13T11:37:59.340 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-13T11:37:59.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:37:59.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.452+0000 7fb1073ce640 1 Processor -- start 2024-06-13T11:37:59.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.453+0000 7fb1073ce640 1 -- start start 2024-06-13T11:37:59.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.453+0000 7fb1073ce640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb10015c250 0x7fb100071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.453+0000 7fb1073ce640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb100072b90 0x7fb1000cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.453+0000 7fb1073ce640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1000b09f0 con 0x7fb1000b0e30 2024-06-13T11:37:59.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.453+0000 7fb1073ce640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb100072700 con 0x7fb10015c250 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb1073ce640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb100071dd0 con 0x7fb100072b90 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb10015c250 0x7fb100071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb10015c250 0x7fb100071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54942/0 (socket says 172.21.15.43:54942) 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 -- 172.21.15.43:0/3866128375 learned_addr learned my addr 172.21.15.43:0/3866128375 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb104969640 1 --2- 172.21.15.43:0/3866128375 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb100072b90 0x7fb1000cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 -- 172.21.15.43:0/3866128375 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb100072b90 msgr2=0x7fb1000cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 --2- 172.21.15.43:0/3866128375 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb100072b90 0x7fb1000cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 -- 172.21.15.43:0/3866128375 >> v1:172.21.15.53:6789/0 conn(0x7fb1000b0e30 legacy=0x7fb1000a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.454+0000 7fb10516a640 1 -- 172.21.15.43:0/3866128375 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1000720b0 con 0x7fb10015c250 2024-06-13T11:37:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb10516a640 1 --2- 172.21.15.43:0/3866128375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb10015c250 0x7fb100071220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009870 tx=0x7fb0fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baef284a6ad9e80 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb0f7fff640 1 -- 172.21.15.43:0/3866128375 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc037070 con 0x7fb10015c250 2024-06-13T11:37:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb0f7fff640 1 -- 172.21.15.43:0/3866128375 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc032440 con 0x7fb10015c250 2024-06-13T11:37:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb0f7fff640 1 -- 172.21.15.43:0/3866128375 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc032810 con 0x7fb10015c250 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb1073ce640 1 -- 172.21.15.43:0/3866128375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb10015c250 msgr2=0x7fb100071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb1073ce640 1 --2- 172.21.15.43:0/3866128375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb10015c250 0x7fb100071220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009870 tx=0x7fb0fc02a210 comp rx=0 tx=0).stop 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb1073ce640 1 -- 172.21.15.43:0/3866128375 shutdown_connections 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb1073ce640 1 --2- 172.21.15.43:0/3866128375 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb100072b90 0x7fb1000cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb1073ce640 1 --2- 172.21.15.43:0/3866128375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb10015c250 0x7fb100071220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.455+0000 7fb1073ce640 1 -- 172.21.15.43:0/3866128375 >> 172.21.15.43:0/3866128375 conn(0x7fb1000b14b0 msgr2=0x7fb1000b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.456+0000 7fb1073ce640 1 -- 172.21.15.43:0/3866128375 shutdown_connections 2024-06-13T11:37:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.456+0000 7fb1073ce640 1 -- 172.21.15.43:0/3866128375 wait complete. 2024-06-13T11:37:59.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.457+0000 7fb1073ce640 1 Processor -- start 2024-06-13T11:37:59.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.457+0000 7fb1073ce640 1 -- start start 2024-06-13T11:37:59.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.457+0000 7fb1073ce640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 0x7fb1001f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.457+0000 7fb1073ce640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1000b0e30 0x7fb1000cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.457+0000 7fb1073ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb10015c250 0x7fb1000ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb1073ce640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb10015c7b0 con 0x7fb100072b90 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb1073ce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb10015c630 con 0x7fb10015c250 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb1073ce640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fb1000cf3b0 con 0x7fb1000b0e30 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 0x7fb1001f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 0x7fb1001f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54954/0 (socket says 172.21.15.43:54954) 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 -- 172.21.15.43:0/1499974483 learned_addr learned my addr 172.21.15.43:0/1499974483 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10596b640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb10015c250 0x7fb1000ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb104969640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1000b0e30 0x7fb1000cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 -- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1000b0e30 msgr2=0x7fb1000cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1000b0e30 0x7fb1000cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 -- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb10015c250 msgr2=0x7fb1000ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb10015c250 0x7fb1000ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 -- 172.21.15.43:0/1499974483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1000ad320 con 0x7fb100072b90 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10596b640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb10015c250 0x7fb1000ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb104969640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1000b0e30 0x7fb1000cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb10516a640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 0x7fb1001f2210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009870 tx=0x7fb0fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc041020 con 0x7fb100072b90 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc030970 con 0x7fb100072b90 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1001592a0 con 0x7fb100072b90 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.458+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc037040 con 0x7fb100072b90 2024-06-13T11:37:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.459+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10015b480 con 0x7fb100072b90 2024-06-13T11:37:59.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.460+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10004ffb0 con 0x7fb100072b90 2024-06-13T11:37:59.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.460+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0fc044020 con 0x7fb100072b90 2024-06-13T11:37:59.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.460+0000 7fb0f5ffb640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb0e406be60 0x7fb0e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.461+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fb0fc0ab8e0 con 0x7fb100072b90 2024-06-13T11:37:59.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.461+0000 7fb104969640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb0e406be60 0x7fb0e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.461+0000 7fb104969640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb0e406be60 0x7fb0e406e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb1001f5710 tx=0x7fb0f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:59.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.465+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb0fc04b030 con 0x7fb100072b90 2024-06-13T11:37:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.689+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1000b4cf0 con 0x7fb100072b90 2024-06-13T11:37:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.689+0000 7fb0f5ffb640 1 -- 172.21.15.43:0/1499974483 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7fb0fc07a190 con 0x7fb100072b90 2024-06-13T11:37:59.689 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:37:59.689 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/1984751010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":1984751010},{"type":"v1","addr":"172.21.15.53:6837","nonce":1984751010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1309249986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1309249986},{"type":"v1","addr":"172.21.15.43:6834","nonce":1309249986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3923577734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3923577734},{"type":"v1","addr":"172.21.15.43:6835","nonce":3923577734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:55.673493+0000","modified":"2024-06-13T11:37:58.686046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/122622789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":122622789},{"type":"v1","addr":"172.21.15.53:6836","nonce":122622789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-06-13T11:37:59.689 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 18 2024-06-13T11:37:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb0e406be60 msgr2=0x7fb0e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb0e406be60 0x7fb0e406e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb1001f5710 tx=0x7fb0f0008040 comp rx=0 tx=0).stop 2024-06-13T11:37:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 msgr2=0x7fb1001f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 0x7fb1001f2210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009870 tx=0x7fb0fc0046c0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 shutdown_connections 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fb0e406be60 0x7fb0e406e320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb10015c250 0x7fb1000ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fb1000b0e30 0x7fb1000cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 --2- 172.21.15.43:0/1499974483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb100072b90 0x7fb1001f2210 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.691+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 >> 172.21.15.43:0/1499974483 conn(0x7fb1000b14b0 msgr2=0x7fb1000a9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.692+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 shutdown_connections 2024-06-13T11:37:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.692+0000 7fb1073ce640 1 -- 172.21.15.43:0/1499974483 wait complete. 2024-06-13T11:37:59.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:37:59.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.807+0000 7efda4990640 1 Processor -- start 2024-06-13T11:37:59.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.807+0000 7efda4990640 1 -- start start 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efda4990640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda01412d0 0x7efda006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efda4990640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efda0162640 0x7efda00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efda4990640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda01416b0 con 0x7efda006f090 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efda4990640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7efda0162a70 con 0x7efda0162640 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efda4990640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efda0162cd0 con 0x7efda01412d0 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efd9ed9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efda0162640 0x7efda00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efd9ed9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efda0162640 0x7efda00b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54964/0 (socket says 172.21.15.43:54964) 2024-06-13T11:37:59.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efd9ed9d640 1 -- 172.21.15.43:0/1243963034 learned_addr learned my addr 172.21.15.43:0/1243963034 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.808+0000 7efd9e59c640 1 --2- 172.21.15.43:0/1243963034 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda01412d0 0x7efda006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.809+0000 7efd9ed9d640 1 -- 172.21.15.43:0/1243963034 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda01412d0 msgr2=0x7efda006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:37:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.809+0000 7efd9ed9d640 1 --2- 172.21.15.43:0/1243963034 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda01412d0 0x7efda006eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.809+0000 7efd9ed9d640 1 -- 172.21.15.43:0/1243963034 >> v1:172.21.15.53:6789/0 conn(0x7efda006f090 legacy=0x7efda0161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.809+0000 7efd9ed9d640 1 -- 172.21.15.43:0/1243963034 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda015ebe0 con 0x7efda0162640 2024-06-13T11:37:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.809+0000 7efd9ed9d640 1 --2- 172.21.15.43:0/1243963034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda0162640 0x7efda00b0ae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efd98009870 tx=0x7efd9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4282b3b21bbd5246 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.809+0000 7efd9d59a640 1 -- 172.21.15.43:0/1243963034 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98037070 con 0x7efda0162640 2024-06-13T11:37:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efd9d59a640 1 -- 172.21.15.43:0/1243963034 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98032440 con 0x7efda0162640 2024-06-13T11:37:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efd9d59a640 1 -- 172.21.15.43:0/1243963034 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98032810 con 0x7efda0162640 2024-06-13T11:37:59.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 -- 172.21.15.43:0/1243963034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda0162640 msgr2=0x7efda00b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 --2- 172.21.15.43:0/1243963034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda0162640 0x7efda00b0ae0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efd98009870 tx=0x7efd9802a270 comp rx=0 tx=0).stop 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 -- 172.21.15.43:0/1243963034 shutdown_connections 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 --2- 172.21.15.43:0/1243963034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda0162640 0x7efda00b0ae0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 --2- 172.21.15.43:0/1243963034 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda01412d0 0x7efda006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 -- 172.21.15.43:0/1243963034 >> 172.21.15.43:0/1243963034 conn(0x7efda006e030 msgr2=0x7efda006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 -- 172.21.15.43:0/1243963034 shutdown_connections 2024-06-13T11:37:59.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.810+0000 7efda4990640 1 -- 172.21.15.43:0/1243963034 wait complete. 2024-06-13T11:37:59.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 Processor -- start 2024-06-13T11:37:59.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 -- start start 2024-06-13T11:37:59.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda006f090 0x7efda0152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 0x7efda0158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda0162640 0x7efda00ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efda015e890 con 0x7efda01412d0 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efda015f1a0 con 0x7efda006f090 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.812+0000 7efda4990640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7efda015f6c0 con 0x7efda0162640 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 0x7efda0158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 0x7efda0158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54980/0 (socket says 172.21.15.43:54980) 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 -- 172.21.15.43:0/2872623753 learned_addr learned my addr 172.21.15.43:0/2872623753 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9ed9d640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda0162640 0x7efda00ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9e59c640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda006f090 0x7efda0152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 -- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda0162640 msgr2=0x7efda00ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda0162640 0x7efda00ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 -- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda006f090 msgr2=0x7efda0152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda006f090 0x7efda0152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 -- 172.21.15.43:0/2872623753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda0154f50 con 0x7efda01412d0 2024-06-13T11:37:59.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9ed9d640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda0162640 0x7efda00ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9e59c640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda006f090 0x7efda0152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd9dd9b640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 0x7efda0158560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c3c0 tx=0x7efd8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880052d0 con 0x7efda01412d0 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd88005490 con 0x7efda01412d0 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda01546b0 con 0x7efda01412d0 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88007260 con 0x7efda01412d0 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.813+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda0154c70 con 0x7efda01412d0 2024-06-13T11:37:59.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.814+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda004ffb0 con 0x7efda01412d0 2024-06-13T11:37:59.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.815+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd88007400 con 0x7efda01412d0 2024-06-13T11:37:59.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.815+0000 7efd96ffd640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efd8006be60 0x7efd8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:37:59.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.815+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7efd8808a470 con 0x7efda01412d0 2024-06-13T11:37:59.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.815+0000 7efd9e59c640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efd8006be60 0x7efd8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:37:59.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.816+0000 7efd9e59c640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efd8006be60 0x7efd8006e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd90009b20 tx=0x7efd900039d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:37:59.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:37:59.820+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd88058c90 con 0x7efda01412d0 2024-06-13T11:38:00.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.003+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efda00d10f0 con 0x7efda01412d0 2024-06-13T11:38:00.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.004+0000 7efd96ffd640 1 -- 172.21.15.43:0/2872623753 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16882 (secure 0 0 0) 0x7efd88058590 con 0x7efda01412d0 2024-06-13T11:38:00.004 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:00.004 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":37,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","created":"2024-06-13T11:36:50.976215+0000","modified":"2024-06-13T11:37:57.310825+0000","last_up_change":"2024-06-13T11:37:00.758910+0000","last_in_change":"2024-06-13T11:36:53.147413+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:37:01.392960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:37:53.511526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-13T11:37:54.658987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09b1ee12-cf55-4bb3-825c-7a325fb780fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6817","nonce":302793859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6819","nonce":302793859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6823","nonce":302793859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":302793859},{"type":"v1","addr":"172.21.15.43:6821","nonce":302793859}]},"public_addr":"172.21.15.43:6817/302793859","cluster_addr":"172.21.15.43:6819/302793859","heartbeat_back_addr":"172.21.15.43:6823/302793859","heartbeat_front_addr":"172.21.15.43:6821/302793859","state":["exists","up"]},{"osd":1,"uuid":"733c6e7d-76eb-480e-b221-7b16846257db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6809","nonce":269259850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6811","nonce":269259850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6815","nonce":269259850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":269259850},{"type":"v1","addr":"172.21.15.43:6813","nonce":269259850}]},"public_addr":"172.21.15.43:6809/269259850","cluster_addr":"172.21.15.43:6811/269259850","heartbeat_back_addr":"172.21.15.43:6815/269259850","heartbeat_front_addr":"172.21.15.43:6813/269259850","state":["exists","up"]},{"osd":2,"uuid":"144432c0-51f8-41d1-b033-ec3ee63ea307","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6801","nonce":3687854261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6803","nonce":3687854261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6807","nonce":3687854261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3687854261},{"type":"v1","addr":"172.21.15.43:6805","nonce":3687854261}]},"public_addr":"172.21.15.43:6801/3687854261","cluster_addr":"172.21.15.43:6803/3687854261","heartbeat_back_addr":"172.21.15.43:6807/3687854261","heartbeat_front_addr":"172.21.15.43:6805/3687854261","state":["exists","up"]},{"osd":3,"uuid":"268e2348-31ca-4b7f-a7f9-3acac1381f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6825","nonce":1749988434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6827","nonce":1749988434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6831","nonce":1749988434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1749988434},{"type":"v1","addr":"172.21.15.43:6829","nonce":1749988434}]},"public_addr":"172.21.15.43:6825/1749988434","cluster_addr":"172.21.15.43:6827/1749988434","heartbeat_back_addr":"172.21.15.43:6831/1749988434","heartbeat_front_addr":"172.21.15.43:6829/1749988434","state":["exists","up"]},{"osd":4,"uuid":"ce14b45f-0565-4254-917e-6db6c8731fac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6825","nonce":3698040505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6827","nonce":3698040505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6831","nonce":3698040505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3698040505},{"type":"v1","addr":"172.21.15.53:6829","nonce":3698040505}]},"public_addr":"172.21.15.53:6825/3698040505","cluster_addr":"172.21.15.53:6827/3698040505","heartbeat_back_addr":"172.21.15.53:6831/3698040505","heartbeat_front_addr":"172.21.15.53:6829/3698040505","state":["exists","up"]},{"osd":5,"uuid":"6b9ad4da-f1ba-46c0-93c3-5acd4d36d6b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6817","nonce":3644833501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6819","nonce":3644833501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6823","nonce":3644833501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3644833501},{"type":"v1","addr":"172.21.15.53:6821","nonce":3644833501}]},"public_addr":"172.21.15.53:6817/3644833501","cluster_addr":"172.21.15.53:6819/3644833501","heartbeat_back_addr":"172.21.15.53:6823/3644833501","heartbeat_front_addr":"172.21.15.53:6821/3644833501","state":["exists","up"]},{"osd":6,"uuid":"ecb9f0e2-0780-43f0-aa5e-2a5acd412abe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6804","nonce":2739056344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6808","nonce":2739056344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6815","nonce":2739056344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2739056344},{"type":"v1","addr":"172.21.15.53:6812","nonce":2739056344}]},"public_addr":"172.21.15.53:6804/2739056344","cluster_addr":"172.21.15.53:6808/2739056344","heartbeat_back_addr":"172.21.15.53:6815/2739056344","heartbeat_front_addr":"172.21.15.53:6812/2739056344","state":["exists","up"]},{"osd":7,"uuid":"3bf998af-5853-4a90-b04d-60956ca29b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6801","nonce":2505473012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6805","nonce":2505473012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6811","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6813","nonce":2505473012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6807","nonce":2505473012},{"type":"v1","addr":"172.21.15.53:6809","nonce":2505473012}]},"public_addr":"172.21.15.53:6801/2505473012","cluster_addr":"172.21.15.53:6805/2505473012","heartbeat_back_addr":"172.21.15.53:6813/2505473012","heartbeat_front_addr":"172.21.15.53:6809/2505473012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.263829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.315216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.335142+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.255344+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.378715+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.397845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.294551+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:36:58.337836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efd8006be60 msgr2=0x7efd8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efd8006be60 0x7efd8006e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd90009b20 tx=0x7efd900039d0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 msgr2=0x7efda0158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 0x7efda0158560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c3c0 tx=0x7efd8800c880 comp rx=0 tx=0).stop 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 shutdown_connections 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7efd8006be60 0x7efd8006e320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7efda0162640 0x7efda00ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efda01412d0 0x7efda0158560 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 --2- 172.21.15.43:0/2872623753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efda006f090 0x7efda0152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 >> 172.21.15.43:0/2872623753 conn(0x7efda006e030 msgr2=0x7efda00719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:00.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 shutdown_connections 2024-06-13T11:38:00.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.006+0000 7efda4990640 1 -- 172.21.15.43:0/2872623753 wait complete. 2024-06-13T11:38:00.017 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-13T11:38:00.017 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:38:00.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.121+0000 7f27dc763640 1 Processor -- start 2024-06-13T11:38:00.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.122+0000 7f27dc763640 1 -- start start 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27dc763640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f27d4070810 0x7f27d415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27dc763640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d415ce60 0x7f27d40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27dc763640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d413f440 con 0x7f27d413f710 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27dc763640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f27d4160ba0 con 0x7f27d4070810 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27dc763640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f27d4160300 con 0x7f27d415ce60 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27da4ff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f27d4070810 0x7f27d415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27d9cfe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f27d413f710 0x7f27d4070bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37110/0 (socket says 172.21.15.43:37110) 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27d9cfe640 1 -- 172.21.15.43:0/1944001473 learned_addr learned my addr 172.21.15.43:0/1944001473 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27dad00640 1 --2- 172.21.15.43:0/1944001473 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d415ce60 0x7f27d40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27da4ff640 1 -- 172.21.15.43:0/1944001473 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d415ce60 msgr2=0x7f27d40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27da4ff640 1 --2- 172.21.15.43:0/1944001473 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d415ce60 0x7f27d40cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27da4ff640 1 -- 172.21.15.43:0/1944001473 >> v1:172.21.15.43:6789/0 conn(0x7f27d413f710 legacy=0x7f27d4070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27da4ff640 1 -- 172.21.15.43:0/1944001473 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d41605e0 con 0x7f27d4070810 2024-06-13T11:38:00.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.123+0000 7f27d94fd640 1 -- 172.21.15.43:0/1944001473 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 857211455 0 0) 0x7f27d413f440 con 0x7f27d413f710 2024-06-13T11:38:00.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.124+0000 7f27da4ff640 1 --2- 172.21.15.43:0/1944001473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d4070810 0x7f27d415fc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27d00097a0 tx=0x7f27d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f6e10d04875df9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.124+0000 7f27d94fd640 1 -- 172.21.15.43:0/1944001473 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0037070 con 0x7f27d4070810 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.124+0000 7f27d94fd640 1 -- 172.21.15.43:0/1944001473 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0032440 con 0x7f27d4070810 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.124+0000 7f27d94fd640 1 -- 172.21.15.43:0/1944001473 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0032810 con 0x7f27d4070810 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.124+0000 7f27dc763640 1 -- 172.21.15.43:0/1944001473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d4070810 msgr2=0x7f27d415fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.124+0000 7f27dc763640 1 --2- 172.21.15.43:0/1944001473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d4070810 0x7f27d415fc70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f27d00097a0 tx=0x7f27d002a180 comp rx=0 tx=0).stop 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.125+0000 7f27dc763640 1 -- 172.21.15.43:0/1944001473 shutdown_connections 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.125+0000 7f27dc763640 1 --2- 172.21.15.43:0/1944001473 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d415ce60 0x7f27d40cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.125+0000 7f27dc763640 1 --2- 172.21.15.43:0/1944001473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d4070810 0x7f27d415fc70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.125+0000 7f27dc763640 1 -- 172.21.15.43:0/1944001473 >> 172.21.15.43:0/1944001473 conn(0x7f27d406f110 msgr2=0x7f27d406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:00.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.125+0000 7f27dc763640 1 -- 172.21.15.43:0/1944001473 shutdown_connections 2024-06-13T11:38:00.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.125+0000 7f27dc763640 1 -- 172.21.15.43:0/1944001473 wait complete. 2024-06-13T11:38:00.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.126+0000 7f27dc763640 1 Processor -- start 2024-06-13T11:38:00.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.126+0000 7f27dc763640 1 -- start start 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.126+0000 7f27dc763640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4070810 0x7f27d4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.126+0000 7f27dc763640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d413f710 0x7f27d40b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dc763640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 0x7f27d413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dc763640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27d413fb90 con 0x7f27d415ce60 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dc763640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f27d40ceba0 con 0x7f27d4070810 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dc763640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f27d415d2f0 con 0x7f27d413f710 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 0x7f27d413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 0x7f27d413c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55000/0 (socket says 172.21.15.43:55000) 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 -- 172.21.15.43:0/1796705831 learned_addr learned my addr 172.21.15.43:0/1796705831 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:00.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27d9cfe640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d413f710 0x7f27d40b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27da4ff640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4070810 0x7f27d4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 -- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d413f710 msgr2=0x7f27d40b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d413f710 0x7f27d40b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 -- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4070810 msgr2=0x7f27d4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4070810 0x7f27d4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 -- 172.21.15.43:0/1796705831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d40b8450 con 0x7f27d415ce60 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27d9cfe640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d413f710 0x7f27d40b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27da4ff640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4070810 0x7f27d4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dad00640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 0x7f27d413c720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009d30 tx=0x7f27cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc018020 con 0x7f27d415ce60 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc014480 con 0x7f27d415ce60 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d413cc60 con 0x7f27d415ce60 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc014870 con 0x7f27d415ce60 2024-06-13T11:38:00.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.127+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d41595c0 con 0x7f27d415ce60 2024-06-13T11:38:00.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.128+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d404ffb0 con 0x7f27d415ce60 2024-06-13T11:38:00.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.129+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27cc005d10 con 0x7f27d415ce60 2024-06-13T11:38:00.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.129+0000 7f27caffd640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f27b806be30 0x7f27b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.129+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f27cc08ba00 con 0x7f27d415ce60 2024-06-13T11:38:00.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.130+0000 7f27da4ff640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f27b806be30 0x7f27b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.130+0000 7f27da4ff640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f27b806be30 0x7f27b806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27d0034000 tx=0x7f27d002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.134+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f27cc022070 con 0x7f27d415ce60 2024-06-13T11:38:00.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.313+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27d40716a0 con 0x7f27b806be30 2024-06-13T11:38:00.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.319+0000 7f27caffd640 1 -- 172.21.15.43:0/1796705831 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250712 (secure 0 0 0) 0x7f27d40716a0 con 0x7f27b806be30 2024-06-13T11:38:00.321 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:00.322 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f27b806be30 msgr2=0x7f27b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f27b806be30 0x7f27b806e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27d0034000 tx=0x7f27d002e000 comp rx=0 tx=0).stop 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 msgr2=0x7f27d413c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 0x7f27d413c720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009d30 tx=0x7f27cc00c490 comp rx=0 tx=0).stop 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 shutdown_connections 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f27b806be30 0x7f27b806e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27d415ce60 0x7f27d413c720 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f27d413f710 0x7f27d40b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 --2- 172.21.15.43:0/1796705831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4070810 0x7f27d4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 >> 172.21.15.43:0/1796705831 conn(0x7f27d406f110 msgr2=0x7f27d415a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 shutdown_connections 2024-06-13T11:38:00.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.322+0000 7f27dc763640 1 -- 172.21.15.43:0/1796705831 wait complete. 2024-06-13T11:38:00.333 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-06-13T11:37:59.361045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253720,"kb_used_data":4256,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721000,"statfs":{"total":773094113280,"available":772834304000,"internally_reserved":0,"allocated":4358144,"data_stored":2494193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.067473"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324984+0000","last_change":"2024-06-13T11:37:56.323330+0000","last_active":"2024-06-13T11:37:56.324984+0000","last_peered":"2024-06-13T11:37:56.324984+0000","last_clean":"2024-06-13T11:37:56.324984+0000","last_became_active":"2024-06-13T11:37:56.323036+0000","last_became_peered":"2024-06-13T11:37:56.323036+0000","last_unstale":"2024-06-13T11:37:56.324984+0000","last_undegraded":"2024-06-13T11:37:56.324984+0000","last_fullsized":"2024-06-13T11:37:56.324984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:21:41.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.318958+0000","last_change":"2024-06-13T11:37:56.317705+0000","last_active":"2024-06-13T11:37:56.318958+0000","last_peered":"2024-06-13T11:37:56.318958+0000","last_clean":"2024-06-13T11:37:56.318958+0000","last_became_active":"2024-06-13T11:37:56.317411+0000","last_became_peered":"2024-06-13T11:37:56.317411+0000","last_unstale":"2024-06-13T11:37:56.318958+0000","last_undegraded":"2024-06-13T11:37:56.318958+0000","last_fullsized":"2024-06-13T11:37:56.318958+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332928+0000","last_change":"2024-06-13T11:37:56.331226+0000","last_active":"2024-06-13T11:37:56.332928+0000","last_peered":"2024-06-13T11:37:56.332928+0000","last_clean":"2024-06-13T11:37:56.332928+0000","last_became_active":"2024-06-13T11:37:56.330954+0000","last_became_peered":"2024-06-13T11:37:56.330954+0000","last_unstale":"2024-06-13T11:37:56.332928+0000","last_undegraded":"2024-06-13T11:37:56.332928+0000","last_fullsized":"2024-06-13T11:37:56.332928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333203+0000","last_change":"2024-06-13T11:37:56.328375+0000","last_active":"2024-06-13T11:37:56.333203+0000","last_peered":"2024-06-13T11:37:56.333203+0000","last_clean":"2024-06-13T11:37:56.333203+0000","last_became_active":"2024-06-13T11:37:56.327777+0000","last_became_peered":"2024-06-13T11:37:56.327777+0000","last_unstale":"2024-06-13T11:37:56.333203+0000","last_undegraded":"2024-06-13T11:37:56.333203+0000","last_fullsized":"2024-06-13T11:37:56.333203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:44.669303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333007+0000","last_change":"2024-06-13T11:37:56.330392+0000","last_active":"2024-06-13T11:37:56.333007+0000","last_peered":"2024-06-13T11:37:56.333007+0000","last_clean":"2024-06-13T11:37:56.333007+0000","last_became_active":"2024-06-13T11:37:56.330114+0000","last_became_peered":"2024-06-13T11:37:56.330114+0000","last_unstale":"2024-06-13T11:37:56.333007+0000","last_undegraded":"2024-06-13T11:37:56.333007+0000","last_fullsized":"2024-06-13T11:37:56.333007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:42.005975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320115+0000","last_change":"2024-06-13T11:37:56.316382+0000","last_active":"2024-06-13T11:37:56.320115+0000","last_peered":"2024-06-13T11:37:56.320115+0000","last_clean":"2024-06-13T11:37:56.320115+0000","last_became_active":"2024-06-13T11:37:56.316079+0000","last_became_peered":"2024-06-13T11:37:56.316079+0000","last_unstale":"2024-06-13T11:37:56.320115+0000","last_undegraded":"2024-06-13T11:37:56.320115+0000","last_fullsized":"2024-06-13T11:37:56.320115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322531+0000","last_change":"2024-06-13T11:37:56.320153+0000","last_active":"2024-06-13T11:37:56.322531+0000","last_peered":"2024-06-13T11:37:56.322531+0000","last_clean":"2024-06-13T11:37:56.322531+0000","last_became_active":"2024-06-13T11:37:56.319164+0000","last_became_peered":"2024-06-13T11:37:56.319164+0000","last_unstale":"2024-06-13T11:37:56.322531+0000","last_undegraded":"2024-06-13T11:37:56.322531+0000","last_fullsized":"2024-06-13T11:37:56.322531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333612+0000","last_change":"2024-06-13T11:37:56.329963+0000","last_active":"2024-06-13T11:37:56.333612+0000","last_peered":"2024-06-13T11:37:56.333612+0000","last_clean":"2024-06-13T11:37:56.333612+0000","last_became_active":"2024-06-13T11:37:56.329661+0000","last_became_peered":"2024-06-13T11:37:56.329661+0000","last_unstale":"2024-06-13T11:37:56.333612+0000","last_undegraded":"2024-06-13T11:37:56.333612+0000","last_fullsized":"2024-06-13T11:37:56.333612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:33:06.820994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326642+0000","last_change":"2024-06-13T11:37:56.323714+0000","last_active":"2024-06-13T11:37:56.326642+0000","last_peered":"2024-06-13T11:37:56.326642+0000","last_clean":"2024-06-13T11:37:56.326642+0000","last_became_active":"2024-06-13T11:37:56.323416+0000","last_became_peered":"2024-06-13T11:37:56.323416+0000","last_unstale":"2024-06-13T11:37:56.326642+0000","last_undegraded":"2024-06-13T11:37:56.326642+0000","last_fullsized":"2024-06-13T11:37:56.326642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:20.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.330128+0000","last_change":"2024-06-13T11:37:56.326263+0000","last_active":"2024-06-13T11:37:56.330128+0000","last_peered":"2024-06-13T11:37:56.330128+0000","last_clean":"2024-06-13T11:37:56.330128+0000","last_became_active":"2024-06-13T11:37:56.325928+0000","last_became_peered":"2024-06-13T11:37:56.325928+0000","last_unstale":"2024-06-13T11:37:56.330128+0000","last_undegraded":"2024-06-13T11:37:56.330128+0000","last_fullsized":"2024-06-13T11:37:56.330128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:28.052669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335071+0000","last_change":"2024-06-13T11:37:56.328875+0000","last_active":"2024-06-13T11:37:56.335071+0000","last_peered":"2024-06-13T11:37:56.335071+0000","last_clean":"2024-06-13T11:37:56.335071+0000","last_became_active":"2024-06-13T11:37:56.328466+0000","last_became_peered":"2024-06-13T11:37:56.328466+0000","last_unstale":"2024-06-13T11:37:56.335071+0000","last_undegraded":"2024-06-13T11:37:56.335071+0000","last_fullsized":"2024-06-13T11:37:56.335071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:32:34.940913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332760+0000","last_change":"2024-06-13T11:37:56.329293+0000","last_active":"2024-06-13T11:37:56.332760+0000","last_peered":"2024-06-13T11:37:56.332760+0000","last_clean":"2024-06-13T11:37:56.332760+0000","last_became_active":"2024-06-13T11:37:56.329023+0000","last_became_peered":"2024-06-13T11:37:56.329023+0000","last_unstale":"2024-06-13T11:37:56.332760+0000","last_undegraded":"2024-06-13T11:37:56.332760+0000","last_fullsized":"2024-06-13T11:37:56.332760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331363+0000","last_change":"2024-06-13T11:37:56.327065+0000","last_active":"2024-06-13T11:37:56.331363+0000","last_peered":"2024-06-13T11:37:56.331363+0000","last_clean":"2024-06-13T11:37:56.331363+0000","last_became_active":"2024-06-13T11:37:56.326677+0000","last_became_peered":"2024-06-13T11:37:56.326677+0000","last_unstale":"2024-06-13T11:37:56.331363+0000","last_undegraded":"2024-06-13T11:37:56.331363+0000","last_fullsized":"2024-06-13T11:37:56.331363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:53.607284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336028+0000","last_change":"2024-06-13T11:37:56.333377+0000","last_active":"2024-06-13T11:37:56.336028+0000","last_peered":"2024-06-13T11:37:56.336028+0000","last_clean":"2024-06-13T11:37:56.336028+0000","last_became_active":"2024-06-13T11:37:56.333061+0000","last_became_peered":"2024-06-13T11:37:56.333061+0000","last_unstale":"2024-06-13T11:37:56.336028+0000","last_undegraded":"2024-06-13T11:37:56.336028+0000","last_fullsized":"2024-06-13T11:37:56.336028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322572+0000","last_change":"2024-06-13T11:37:56.320422+0000","last_active":"2024-06-13T11:37:56.322572+0000","last_peered":"2024-06-13T11:37:56.322572+0000","last_clean":"2024-06-13T11:37:56.322572+0000","last_became_active":"2024-06-13T11:37:56.319882+0000","last_became_peered":"2024-06-13T11:37:56.319882+0000","last_unstale":"2024-06-13T11:37:56.322572+0000","last_undegraded":"2024-06-13T11:37:56.322572+0000","last_fullsized":"2024-06-13T11:37:56.322572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:57:21.388732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338304+0000","last_change":"2024-06-13T11:37:56.337108+0000","last_active":"2024-06-13T11:37:56.338304+0000","last_peered":"2024-06-13T11:37:56.338304+0000","last_clean":"2024-06-13T11:37:56.338304+0000","last_became_active":"2024-06-13T11:37:56.336726+0000","last_became_peered":"2024-06-13T11:37:56.336726+0000","last_unstale":"2024-06-13T11:37:56.338304+0000","last_undegraded":"2024-06-13T11:37:56.338304+0000","last_fullsized":"2024-06-13T11:37:56.338304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338335+0000","last_change":"2024-06-13T11:37:56.336965+0000","last_active":"2024-06-13T11:37:56.338335+0000","last_peered":"2024-06-13T11:37:56.338335+0000","last_clean":"2024-06-13T11:37:56.338335+0000","last_became_active":"2024-06-13T11:37:56.336655+0000","last_became_peered":"2024-06-13T11:37:56.336655+0000","last_unstale":"2024-06-13T11:37:56.338335+0000","last_undegraded":"2024-06-13T11:37:56.338335+0000","last_fullsized":"2024-06-13T11:37:56.338335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322566+0000","last_change":"2024-06-13T11:37:56.317302+0000","last_active":"2024-06-13T11:37:56.322566+0000","last_peered":"2024-06-13T11:37:56.322566+0000","last_clean":"2024-06-13T11:37:56.322566+0000","last_became_active":"2024-06-13T11:37:56.316660+0000","last_became_peered":"2024-06-13T11:37:56.316660+0000","last_unstale":"2024-06-13T11:37:56.322566+0000","last_undegraded":"2024-06-13T11:37:56.322566+0000","last_fullsized":"2024-06-13T11:37:56.322566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:41:42.438398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322585+0000","last_change":"2024-06-13T11:37:56.320203+0000","last_active":"2024-06-13T11:37:56.322585+0000","last_peered":"2024-06-13T11:37:56.322585+0000","last_clean":"2024-06-13T11:37:56.322585+0000","last_became_active":"2024-06-13T11:37:56.319914+0000","last_became_peered":"2024-06-13T11:37:56.319914+0000","last_unstale":"2024-06-13T11:37:56.322585+0000","last_undegraded":"2024-06-13T11:37:56.322585+0000","last_fullsized":"2024-06-13T11:37:56.322585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:34.553237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331239+0000","last_change":"2024-06-13T11:37:56.328768+0000","last_active":"2024-06-13T11:37:56.331239+0000","last_peered":"2024-06-13T11:37:56.331239+0000","last_clean":"2024-06-13T11:37:56.331239+0000","last_became_active":"2024-06-13T11:37:56.328430+0000","last_became_peered":"2024-06-13T11:37:56.328430+0000","last_unstale":"2024-06-13T11:37:56.331239+0000","last_undegraded":"2024-06-13T11:37:56.331239+0000","last_fullsized":"2024-06-13T11:37:56.331239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336588+0000","last_change":"2024-06-13T11:37:56.333430+0000","last_active":"2024-06-13T11:37:56.336588+0000","last_peered":"2024-06-13T11:37:56.336588+0000","last_clean":"2024-06-13T11:37:56.336588+0000","last_became_active":"2024-06-13T11:37:56.333164+0000","last_became_peered":"2024-06-13T11:37:56.333164+0000","last_unstale":"2024-06-13T11:37:56.336588+0000","last_undegraded":"2024-06-13T11:37:56.336588+0000","last_fullsized":"2024-06-13T11:37:56.336588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328011+0000","last_change":"2024-06-13T11:37:56.326591+0000","last_active":"2024-06-13T11:37:56.328011+0000","last_peered":"2024-06-13T11:37:56.328011+0000","last_clean":"2024-06-13T11:37:56.328011+0000","last_became_active":"2024-06-13T11:37:56.326263+0000","last_became_peered":"2024-06-13T11:37:56.326263+0000","last_unstale":"2024-06-13T11:37:56.328011+0000","last_undegraded":"2024-06-13T11:37:56.328011+0000","last_fullsized":"2024-06-13T11:37:56.328011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:04:39.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.327272+0000","last_change":"2024-06-13T11:37:56.325540+0000","last_active":"2024-06-13T11:37:56.327272+0000","last_peered":"2024-06-13T11:37:56.327272+0000","last_clean":"2024-06-13T11:37:56.327272+0000","last_became_active":"2024-06-13T11:37:56.325219+0000","last_became_peered":"2024-06-13T11:37:56.325219+0000","last_unstale":"2024-06-13T11:37:56.327272+0000","last_undegraded":"2024-06-13T11:37:56.327272+0000","last_fullsized":"2024-06-13T11:37:56.327272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328276+0000","last_change":"2024-06-13T11:37:56.323559+0000","last_active":"2024-06-13T11:37:56.328276+0000","last_peered":"2024-06-13T11:37:56.328276+0000","last_clean":"2024-06-13T11:37:56.328276+0000","last_became_active":"2024-06-13T11:37:56.323291+0000","last_became_peered":"2024-06-13T11:37:56.323291+0000","last_unstale":"2024-06-13T11:37:56.328276+0000","last_undegraded":"2024-06-13T11:37:56.328276+0000","last_fullsized":"2024-06-13T11:37:56.328276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:38:46.544540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336610+0000","last_change":"2024-06-13T11:37:56.334243+0000","last_active":"2024-06-13T11:37:56.336610+0000","last_peered":"2024-06-13T11:37:56.336610+0000","last_clean":"2024-06-13T11:37:56.336610+0000","last_became_active":"2024-06-13T11:37:56.333952+0000","last_became_peered":"2024-06-13T11:37:56.333952+0000","last_unstale":"2024-06-13T11:37:56.336610+0000","last_undegraded":"2024-06-13T11:37:56.336610+0000","last_fullsized":"2024-06-13T11:37:56.336610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321475+0000","last_change":"2024-06-13T11:37:56.318049+0000","last_active":"2024-06-13T11:37:56.321475+0000","last_peered":"2024-06-13T11:37:56.321475+0000","last_clean":"2024-06-13T11:37:56.321475+0000","last_became_active":"2024-06-13T11:37:56.317769+0000","last_became_peered":"2024-06-13T11:37:56.317769+0000","last_unstale":"2024-06-13T11:37:56.321475+0000","last_undegraded":"2024-06-13T11:37:56.321475+0000","last_fullsized":"2024-06-13T11:37:56.321475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338431+0000","last_change":"2024-06-13T11:37:56.336846+0000","last_active":"2024-06-13T11:37:56.338431+0000","last_peered":"2024-06-13T11:37:56.338431+0000","last_clean":"2024-06-13T11:37:56.338431+0000","last_became_active":"2024-06-13T11:37:56.336555+0000","last_became_peered":"2024-06-13T11:37:56.336555+0000","last_unstale":"2024-06-13T11:37:56.338431+0000","last_undegraded":"2024-06-13T11:37:56.338431+0000","last_fullsized":"2024-06-13T11:37:56.338431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.300009+0000","last_change":"2024-06-13T11:37:54.300009+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.300009+0000","last_undegraded":"2024-06-13T11:37:54.300009+0000","last_fullsized":"2024-06-13T11:37:54.300009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332783+0000","last_change":"2024-06-13T11:37:56.330952+0000","last_active":"2024-06-13T11:37:56.332783+0000","last_peered":"2024-06-13T11:37:56.332783+0000","last_clean":"2024-06-13T11:37:56.332783+0000","last_became_active":"2024-06-13T11:37:56.330604+0000","last_became_peered":"2024-06-13T11:37:56.330604+0000","last_unstale":"2024-06-13T11:37:56.332783+0000","last_undegraded":"2024-06-13T11:37:56.332783+0000","last_fullsized":"2024-06-13T11:37:56.332783+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337848+0000","last_change":"2024-06-13T11:37:55.319411+0000","last_active":"2024-06-13T11:37:56.337848+0000","last_peered":"2024-06-13T11:37:56.337848+0000","last_clean":"2024-06-13T11:37:56.337848+0000","last_became_active":"2024-06-13T11:37:55.318305+0000","last_became_peered":"2024-06-13T11:37:55.318305+0000","last_unstale":"2024-06-13T11:37:56.337848+0000","last_undegraded":"2024-06-13T11:37:56.337848+0000","last_fullsized":"2024-06-13T11:37:56.337848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:15:12.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337375+0000","last_change":"2024-06-13T11:37:56.334255+0000","last_active":"2024-06-13T11:37:56.337375+0000","last_peered":"2024-06-13T11:37:56.337375+0000","last_clean":"2024-06-13T11:37:56.337375+0000","last_became_active":"2024-06-13T11:37:56.333761+0000","last_became_peered":"2024-06-13T11:37:56.333761+0000","last_unstale":"2024-06-13T11:37:56.337375+0000","last_undegraded":"2024-06-13T11:37:56.337375+0000","last_fullsized":"2024-06-13T11:37:56.337375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324180+0000","last_change":"2024-06-13T11:37:55.318481+0000","last_active":"2024-06-13T11:37:56.324180+0000","last_peered":"2024-06-13T11:37:56.324180+0000","last_clean":"2024-06-13T11:37:56.324180+0000","last_became_active":"2024-06-13T11:37:55.318164+0000","last_became_peered":"2024-06-13T11:37:55.318164+0000","last_unstale":"2024-06-13T11:37:56.324180+0000","last_undegraded":"2024-06-13T11:37:56.324180+0000","last_fullsized":"2024-06-13T11:37:56.324180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:33.823945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319390+0000","last_change":"2024-06-13T11:37:56.318534+0000","last_active":"2024-06-13T11:37:56.319390+0000","last_peered":"2024-06-13T11:37:56.319390+0000","last_clean":"2024-06-13T11:37:56.319390+0000","last_became_active":"2024-06-13T11:37:56.318248+0000","last_became_peered":"2024-06-13T11:37:56.318248+0000","last_unstale":"2024-06-13T11:37:56.319390+0000","last_undegraded":"2024-06-13T11:37:56.319390+0000","last_fullsized":"2024-06-13T11:37:56.319390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:24.453927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335250+0000","last_change":"2024-06-13T11:37:55.308705+0000","last_active":"2024-06-13T11:37:56.335250+0000","last_peered":"2024-06-13T11:37:56.335250+0000","last_clean":"2024-06-13T11:37:56.335250+0000","last_became_active":"2024-06-13T11:37:55.308399+0000","last_became_peered":"2024-06-13T11:37:55.308399+0000","last_unstale":"2024-06-13T11:37:56.335250+0000","last_undegraded":"2024-06-13T11:37:56.335250+0000","last_fullsized":"2024-06-13T11:37:56.335250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326916+0000","last_change":"2024-06-13T11:37:56.325979+0000","last_active":"2024-06-13T11:37:56.326916+0000","last_peered":"2024-06-13T11:37:56.326916+0000","last_clean":"2024-06-13T11:37:56.326916+0000","last_became_active":"2024-06-13T11:37:56.325682+0000","last_became_peered":"2024-06-13T11:37:56.325682+0000","last_unstale":"2024-06-13T11:37:56.326916+0000","last_undegraded":"2024-06-13T11:37:56.326916+0000","last_fullsized":"2024-06-13T11:37:56.326916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:34.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326923+0000","last_change":"2024-06-13T11:37:55.314283+0000","last_active":"2024-06-13T11:37:56.326923+0000","last_peered":"2024-06-13T11:37:56.326923+0000","last_clean":"2024-06-13T11:37:56.326923+0000","last_became_active":"2024-06-13T11:37:55.313981+0000","last_became_peered":"2024-06-13T11:37:55.313981+0000","last_unstale":"2024-06-13T11:37:56.326923+0000","last_undegraded":"2024-06-13T11:37:56.326923+0000","last_fullsized":"2024-06-13T11:37:56.326923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:32.867795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322553+0000","last_change":"2024-06-13T11:37:56.320173+0000","last_active":"2024-06-13T11:37:56.322553+0000","last_peered":"2024-06-13T11:37:56.322553+0000","last_clean":"2024-06-13T11:37:56.322553+0000","last_became_active":"2024-06-13T11:37:56.319550+0000","last_became_peered":"2024-06-13T11:37:56.319550+0000","last_unstale":"2024-06-13T11:37:56.322553+0000","last_undegraded":"2024-06-13T11:37:56.322553+0000","last_fullsized":"2024-06-13T11:37:56.322553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337594+0000","last_change":"2024-06-13T11:37:55.319302+0000","last_active":"2024-06-13T11:37:56.337594+0000","last_peered":"2024-06-13T11:37:56.337594+0000","last_clean":"2024-06-13T11:37:56.337594+0000","last_became_active":"2024-06-13T11:37:55.318884+0000","last_became_peered":"2024-06-13T11:37:55.318884+0000","last_unstale":"2024-06-13T11:37:56.337594+0000","last_undegraded":"2024-06-13T11:37:56.337594+0000","last_fullsized":"2024-06-13T11:37:56.337594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328993+0000","last_change":"2024-06-13T11:37:56.325772+0000","last_active":"2024-06-13T11:37:56.328993+0000","last_peered":"2024-06-13T11:37:56.328993+0000","last_clean":"2024-06-13T11:37:56.328993+0000","last_became_active":"2024-06-13T11:37:56.325245+0000","last_became_peered":"2024-06-13T11:37:56.325245+0000","last_unstale":"2024-06-13T11:37:56.328993+0000","last_undegraded":"2024-06-13T11:37:56.328993+0000","last_fullsized":"2024-06-13T11:37:56.328993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313464+0000","last_change":"2024-06-13T11:37:55.312037+0000","last_active":"2024-06-13T11:37:56.313464+0000","last_peered":"2024-06-13T11:37:56.313464+0000","last_clean":"2024-06-13T11:37:56.313464+0000","last_became_active":"2024-06-13T11:37:55.311676+0000","last_became_peered":"2024-06-13T11:37:55.311676+0000","last_unstale":"2024-06-13T11:37:56.313464+0000","last_undegraded":"2024-06-13T11:37:56.313464+0000","last_fullsized":"2024-06-13T11:37:56.313464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333571+0000","last_change":"2024-06-13T11:37:56.331802+0000","last_active":"2024-06-13T11:37:56.333571+0000","last_peered":"2024-06-13T11:37:56.333571+0000","last_clean":"2024-06-13T11:37:56.333571+0000","last_became_active":"2024-06-13T11:37:56.331443+0000","last_became_peered":"2024-06-13T11:37:56.331443+0000","last_unstale":"2024-06-13T11:37:56.333571+0000","last_undegraded":"2024-06-13T11:37:56.333571+0000","last_fullsized":"2024-06-13T11:37:56.333571+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:22.710612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314234+0000","last_change":"2024-06-13T11:37:55.309937+0000","last_active":"2024-06-13T11:37:56.314234+0000","last_peered":"2024-06-13T11:37:56.314234+0000","last_clean":"2024-06-13T11:37:56.314234+0000","last_became_active":"2024-06-13T11:37:55.309677+0000","last_became_peered":"2024-06-13T11:37:55.309677+0000","last_unstale":"2024-06-13T11:37:56.314234+0000","last_undegraded":"2024-06-13T11:37:56.314234+0000","last_fullsized":"2024-06-13T11:37:56.314234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:06:17.518923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333134+0000","last_change":"2024-06-13T11:37:56.328114+0000","last_active":"2024-06-13T11:37:56.333134+0000","last_peered":"2024-06-13T11:37:56.333134+0000","last_clean":"2024-06-13T11:37:56.333134+0000","last_became_active":"2024-06-13T11:37:56.327404+0000","last_became_peered":"2024-06-13T11:37:56.327404+0000","last_unstale":"2024-06-13T11:37:56.333134+0000","last_undegraded":"2024-06-13T11:37:56.333134+0000","last_fullsized":"2024-06-13T11:37:56.333134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:47.251555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.311070+0000","last_change":"2024-06-13T11:37:55.317546+0000","last_active":"2024-06-13T11:37:56.311070+0000","last_peered":"2024-06-13T11:37:56.311070+0000","last_clean":"2024-06-13T11:37:56.311070+0000","last_became_active":"2024-06-13T11:37:55.317278+0000","last_became_peered":"2024-06-13T11:37:55.317278+0000","last_unstale":"2024-06-13T11:37:56.311070+0000","last_undegraded":"2024-06-13T11:37:56.311070+0000","last_fullsized":"2024-06-13T11:37:56.311070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:57.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336574+0000","last_change":"2024-06-13T11:37:56.333326+0000","last_active":"2024-06-13T11:37:56.336574+0000","last_peered":"2024-06-13T11:37:56.336574+0000","last_clean":"2024-06-13T11:37:56.336574+0000","last_became_active":"2024-06-13T11:37:56.332950+0000","last_became_peered":"2024-06-13T11:37:56.332950+0000","last_unstale":"2024-06-13T11:37:56.336574+0000","last_undegraded":"2024-06-13T11:37:56.336574+0000","last_fullsized":"2024-06-13T11:37:56.336574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.309602+0000","last_change":"2024-06-13T11:37:55.313056+0000","last_active":"2024-06-13T11:37:56.309602+0000","last_peered":"2024-06-13T11:37:56.309602+0000","last_clean":"2024-06-13T11:37:56.309602+0000","last_became_active":"2024-06-13T11:37:55.312782+0000","last_became_peered":"2024-06-13T11:37:55.312782+0000","last_unstale":"2024-06-13T11:37:56.309602+0000","last_undegraded":"2024-06-13T11:37:56.309602+0000","last_fullsized":"2024-06-13T11:37:56.309602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:06.789673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336735+0000","last_change":"2024-06-13T11:37:56.335836+0000","last_active":"2024-06-13T11:37:56.336735+0000","last_peered":"2024-06-13T11:37:56.336735+0000","last_clean":"2024-06-13T11:37:56.336735+0000","last_became_active":"2024-06-13T11:37:56.335541+0000","last_became_peered":"2024-06-13T11:37:56.335541+0000","last_unstale":"2024-06-13T11:37:56.336735+0000","last_undegraded":"2024-06-13T11:37:56.336735+0000","last_fullsized":"2024-06-13T11:37:56.336735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335147+0000","last_change":"2024-06-13T11:37:55.312146+0000","last_active":"2024-06-13T11:37:56.335147+0000","last_peered":"2024-06-13T11:37:56.335147+0000","last_clean":"2024-06-13T11:37:56.335147+0000","last_became_active":"2024-06-13T11:37:55.311692+0000","last_became_peered":"2024-06-13T11:37:55.311692+0000","last_unstale":"2024-06-13T11:37:56.335147+0000","last_undegraded":"2024-06-13T11:37:56.335147+0000","last_fullsized":"2024-06-13T11:37:56.335147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:52.165608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331247+0000","last_change":"2024-06-13T11:37:56.328733+0000","last_active":"2024-06-13T11:37:56.331247+0000","last_peered":"2024-06-13T11:37:56.331247+0000","last_clean":"2024-06-13T11:37:56.331247+0000","last_became_active":"2024-06-13T11:37:56.328353+0000","last_became_peered":"2024-06-13T11:37:56.328353+0000","last_unstale":"2024-06-13T11:37:56.331247+0000","last_undegraded":"2024-06-13T11:37:56.331247+0000","last_fullsized":"2024-06-13T11:37:56.331247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339092+0000","last_change":"2024-06-13T11:37:55.309442+0000","last_active":"2024-06-13T11:37:56.339092+0000","last_peered":"2024-06-13T11:37:56.339092+0000","last_clean":"2024-06-13T11:37:56.339092+0000","last_became_active":"2024-06-13T11:37:55.309109+0000","last_became_peered":"2024-06-13T11:37:55.309109+0000","last_unstale":"2024-06-13T11:37:56.339092+0000","last_undegraded":"2024-06-13T11:37:56.339092+0000","last_fullsized":"2024-06-13T11:37:56.339092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:55.069527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326115+0000","last_change":"2024-06-13T11:37:56.323618+0000","last_active":"2024-06-13T11:37:56.326115+0000","last_peered":"2024-06-13T11:37:56.326115+0000","last_clean":"2024-06-13T11:37:56.326115+0000","last_became_active":"2024-06-13T11:37:56.323333+0000","last_became_peered":"2024-06-13T11:37:56.323333+0000","last_unstale":"2024-06-13T11:37:56.326115+0000","last_undegraded":"2024-06-13T11:37:56.326115+0000","last_fullsized":"2024-06-13T11:37:56.326115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:39.954448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333494+0000","last_change":"2024-06-13T11:37:55.316960+0000","last_active":"2024-06-13T11:37:56.333494+0000","last_peered":"2024-06-13T11:37:56.333494+0000","last_clean":"2024-06-13T11:37:56.333494+0000","last_became_active":"2024-06-13T11:37:55.316663+0000","last_became_peered":"2024-06-13T11:37:55.316663+0000","last_unstale":"2024-06-13T11:37:56.333494+0000","last_undegraded":"2024-06-13T11:37:56.333494+0000","last_fullsized":"2024-06-13T11:37:56.333494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:06.986712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334322+0000","last_change":"2024-06-13T11:37:56.327997+0000","last_active":"2024-06-13T11:37:56.334322+0000","last_peered":"2024-06-13T11:37:56.334322+0000","last_clean":"2024-06-13T11:37:56.334322+0000","last_became_active":"2024-06-13T11:37:56.327722+0000","last_became_peered":"2024-06-13T11:37:56.327722+0000","last_unstale":"2024-06-13T11:37:56.334322+0000","last_undegraded":"2024-06-13T11:37:56.334322+0000","last_fullsized":"2024-06-13T11:37:56.334322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:58:30.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313590+0000","last_change":"2024-06-13T11:37:55.310340+0000","last_active":"2024-06-13T11:37:56.313590+0000","last_peered":"2024-06-13T11:37:56.313590+0000","last_clean":"2024-06-13T11:37:56.313590+0000","last_became_active":"2024-06-13T11:37:55.310063+0000","last_became_peered":"2024-06-13T11:37:55.310063+0000","last_unstale":"2024-06-13T11:37:56.313590+0000","last_undegraded":"2024-06-13T11:37:56.313590+0000","last_fullsized":"2024-06-13T11:37:56.313590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:38.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336464+0000","last_change":"2024-06-13T11:37:56.333319+0000","last_active":"2024-06-13T11:37:56.336464+0000","last_peered":"2024-06-13T11:37:56.336464+0000","last_clean":"2024-06-13T11:37:56.336464+0000","last_became_active":"2024-06-13T11:37:56.333028+0000","last_became_peered":"2024-06-13T11:37:56.333028+0000","last_unstale":"2024-06-13T11:37:56.336464+0000","last_undegraded":"2024-06-13T11:37:56.336464+0000","last_fullsized":"2024-06-13T11:37:56.336464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.299520+0000","last_change":"2024-06-13T11:37:54.299520+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.299520+0000","last_undegraded":"2024-06-13T11:37:54.299520+0000","last_fullsized":"2024-06-13T11:37:54.299520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333552+0000","last_change":"2024-06-13T11:37:56.330323+0000","last_active":"2024-06-13T11:37:56.333552+0000","last_peered":"2024-06-13T11:37:56.333552+0000","last_clean":"2024-06-13T11:37:56.333552+0000","last_became_active":"2024-06-13T11:37:56.330008+0000","last_became_peered":"2024-06-13T11:37:56.330008+0000","last_unstale":"2024-06-13T11:37:56.333552+0000","last_undegraded":"2024-06-13T11:37:56.333552+0000","last_fullsized":"2024-06-13T11:37:56.333552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:41:16.066555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339466+0000","last_change":"2024-06-13T11:37:55.317870+0000","last_active":"2024-06-13T11:37:56.339466+0000","last_peered":"2024-06-13T11:37:56.339466+0000","last_clean":"2024-06-13T11:37:56.339466+0000","last_became_active":"2024-06-13T11:37:55.317569+0000","last_became_peered":"2024-06-13T11:37:55.317569+0000","last_unstale":"2024-06-13T11:37:56.339466+0000","last_undegraded":"2024-06-13T11:37:56.339466+0000","last_fullsized":"2024-06-13T11:37:56.339466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320986+0000","last_change":"2024-06-13T11:37:56.318768+0000","last_active":"2024-06-13T11:37:56.320986+0000","last_peered":"2024-06-13T11:37:56.320986+0000","last_clean":"2024-06-13T11:37:56.320986+0000","last_became_active":"2024-06-13T11:37:56.318414+0000","last_became_peered":"2024-06-13T11:37:56.318414+0000","last_unstale":"2024-06-13T11:37:56.320986+0000","last_undegraded":"2024-06-13T11:37:56.320986+0000","last_fullsized":"2024-06-13T11:37:56.320986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:43.606286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.325219+0000","last_change":"2024-06-13T11:37:55.314832+0000","last_active":"2024-06-13T11:37:56.325219+0000","last_peered":"2024-06-13T11:37:56.325219+0000","last_clean":"2024-06-13T11:37:56.325219+0000","last_became_active":"2024-06-13T11:37:55.314553+0000","last_became_peered":"2024-06-13T11:37:55.314553+0000","last_unstale":"2024-06-13T11:37:56.325219+0000","last_undegraded":"2024-06-13T11:37:56.325219+0000","last_fullsized":"2024-06-13T11:37:56.325219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:33.732710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335202+0000","last_change":"2024-06-13T11:37:56.329960+0000","last_active":"2024-06-13T11:37:56.335202+0000","last_peered":"2024-06-13T11:37:56.335202+0000","last_clean":"2024-06-13T11:37:56.335202+0000","last_became_active":"2024-06-13T11:37:56.327480+0000","last_became_peered":"2024-06-13T11:37:56.327480+0000","last_unstale":"2024-06-13T11:37:56.335202+0000","last_undegraded":"2024-06-13T11:37:56.335202+0000","last_fullsized":"2024-06-13T11:37:56.335202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:45.975185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332385+0000","last_change":"2024-06-13T11:37:55.310530+0000","last_active":"2024-06-13T11:37:56.332385+0000","last_peered":"2024-06-13T11:37:56.332385+0000","last_clean":"2024-06-13T11:37:56.332385+0000","last_became_active":"2024-06-13T11:37:55.310267+0000","last_became_peered":"2024-06-13T11:37:55.310267+0000","last_unstale":"2024-06-13T11:37:56.332385+0000","last_undegraded":"2024-06-13T11:37:56.332385+0000","last_fullsized":"2024-06-13T11:37:56.332385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333960+0000","last_change":"2024-06-13T11:37:56.330670+0000","last_active":"2024-06-13T11:37:56.333960+0000","last_peered":"2024-06-13T11:37:56.333960+0000","last_clean":"2024-06-13T11:37:56.333960+0000","last_became_active":"2024-06-13T11:37:56.330391+0000","last_became_peered":"2024-06-13T11:37:56.330391+0000","last_unstale":"2024-06-13T11:37:56.333960+0000","last_undegraded":"2024-06-13T11:37:56.333960+0000","last_fullsized":"2024-06-13T11:37:56.333960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334822+0000","last_change":"2024-06-13T11:37:55.315973+0000","last_active":"2024-06-13T11:37:56.334822+0000","last_peered":"2024-06-13T11:37:56.334822+0000","last_clean":"2024-06-13T11:37:56.334822+0000","last_became_active":"2024-06-13T11:37:55.315613+0000","last_became_peered":"2024-06-13T11:37:55.315613+0000","last_unstale":"2024-06-13T11:37:56.334822+0000","last_undegraded":"2024-06-13T11:37:56.334822+0000","last_fullsized":"2024-06-13T11:37:56.334822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:39:13.330192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322587+0000","last_change":"2024-06-13T11:37:56.317844+0000","last_active":"2024-06-13T11:37:56.322587+0000","last_peered":"2024-06-13T11:37:56.322587+0000","last_clean":"2024-06-13T11:37:56.322587+0000","last_became_active":"2024-06-13T11:37:56.317533+0000","last_became_peered":"2024-06-13T11:37:56.317533+0000","last_unstale":"2024-06-13T11:37:56.322587+0000","last_undegraded":"2024-06-13T11:37:56.322587+0000","last_fullsized":"2024-06-13T11:37:56.322587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:20.305235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313660+0000","last_change":"2024-06-13T11:37:55.317261+0000","last_active":"2024-06-13T11:37:56.313660+0000","last_peered":"2024-06-13T11:37:56.313660+0000","last_clean":"2024-06-13T11:37:56.313660+0000","last_became_active":"2024-06-13T11:37:55.316983+0000","last_became_peered":"2024-06-13T11:37:55.316983+0000","last_unstale":"2024-06-13T11:37:56.313660+0000","last_undegraded":"2024-06-13T11:37:56.313660+0000","last_fullsized":"2024-06-13T11:37:56.313660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:19.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336402+0000","last_change":"2024-06-13T11:37:56.332777+0000","last_active":"2024-06-13T11:37:56.336402+0000","last_peered":"2024-06-13T11:37:56.336402+0000","last_clean":"2024-06-13T11:37:56.336402+0000","last_became_active":"2024-06-13T11:37:56.332287+0000","last_became_peered":"2024-06-13T11:37:56.332287+0000","last_unstale":"2024-06-13T11:37:56.336402+0000","last_undegraded":"2024-06-13T11:37:56.336402+0000","last_fullsized":"2024-06-13T11:37:56.336402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335535+0000","last_change":"2024-06-13T11:37:55.318031+0000","last_active":"2024-06-13T11:37:56.335535+0000","last_peered":"2024-06-13T11:37:56.335535+0000","last_clean":"2024-06-13T11:37:56.335535+0000","last_became_active":"2024-06-13T11:37:55.316716+0000","last_became_peered":"2024-06-13T11:37:55.316716+0000","last_unstale":"2024-06-13T11:37:56.335535+0000","last_undegraded":"2024-06-13T11:37:56.335535+0000","last_fullsized":"2024-06-13T11:37:56.335535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:54:29.089099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336951+0000","last_change":"2024-06-13T11:37:56.336329+0000","last_active":"2024-06-13T11:37:56.336951+0000","last_peered":"2024-06-13T11:37:56.336951+0000","last_clean":"2024-06-13T11:37:56.336951+0000","last_became_active":"2024-06-13T11:37:56.335972+0000","last_became_peered":"2024-06-13T11:37:56.335972+0000","last_unstale":"2024-06-13T11:37:56.336951+0000","last_undegraded":"2024-06-13T11:37:56.336951+0000","last_fullsized":"2024-06-13T11:37:56.336951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306671+0000","last_change":"2024-06-13T11:37:55.312486+0000","last_active":"2024-06-13T11:37:56.306671+0000","last_peered":"2024-06-13T11:37:56.306671+0000","last_clean":"2024-06-13T11:37:56.306671+0000","last_became_active":"2024-06-13T11:37:55.312206+0000","last_became_peered":"2024-06-13T11:37:55.312206+0000","last_unstale":"2024-06-13T11:37:56.306671+0000","last_undegraded":"2024-06-13T11:37:56.306671+0000","last_fullsized":"2024-06-13T11:37:56.306671+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:14:01.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315037+0000","last_change":"2024-06-13T11:37:56.313649+0000","last_active":"2024-06-13T11:37:56.315037+0000","last_peered":"2024-06-13T11:37:56.315037+0000","last_clean":"2024-06-13T11:37:56.315037+0000","last_became_active":"2024-06-13T11:37:56.313376+0000","last_became_peered":"2024-06-13T11:37:56.313376+0000","last_unstale":"2024-06-13T11:37:56.315037+0000","last_undegraded":"2024-06-13T11:37:56.315037+0000","last_fullsized":"2024-06-13T11:37:56.315037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320310+0000","last_change":"2024-06-13T11:37:55.315779+0000","last_active":"2024-06-13T11:37:56.320310+0000","last_peered":"2024-06-13T11:37:56.320310+0000","last_clean":"2024-06-13T11:37:56.320310+0000","last_became_active":"2024-06-13T11:37:55.315487+0000","last_became_peered":"2024-06-13T11:37:55.315487+0000","last_unstale":"2024-06-13T11:37:56.320310+0000","last_undegraded":"2024-06-13T11:37:56.320310+0000","last_fullsized":"2024-06-13T11:37:56.320310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334552+0000","last_change":"2024-06-13T11:37:56.332594+0000","last_active":"2024-06-13T11:37:56.334552+0000","last_peered":"2024-06-13T11:37:56.334552+0000","last_clean":"2024-06-13T11:37:56.334552+0000","last_became_active":"2024-06-13T11:37:56.332265+0000","last_became_peered":"2024-06-13T11:37:56.332265+0000","last_unstale":"2024-06-13T11:37:56.334552+0000","last_undegraded":"2024-06-13T11:37:56.334552+0000","last_fullsized":"2024-06-13T11:37:56.334552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:04:56.197473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306156+0000","last_change":"2024-06-13T11:37:55.314354+0000","last_active":"2024-06-13T11:37:56.306156+0000","last_peered":"2024-06-13T11:37:56.306156+0000","last_clean":"2024-06-13T11:37:56.306156+0000","last_became_active":"2024-06-13T11:37:55.314034+0000","last_became_peered":"2024-06-13T11:37:55.314034+0000","last_unstale":"2024-06-13T11:37:56.306156+0000","last_undegraded":"2024-06-13T11:37:56.306156+0000","last_fullsized":"2024-06-13T11:37:56.306156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:29.902564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321709+0000","last_change":"2024-06-13T11:37:56.318282+0000","last_active":"2024-06-13T11:37:56.321709+0000","last_peered":"2024-06-13T11:37:56.321709+0000","last_clean":"2024-06-13T11:37:56.321709+0000","last_became_active":"2024-06-13T11:37:56.317985+0000","last_became_peered":"2024-06-13T11:37:56.317985+0000","last_unstale":"2024-06-13T11:37:56.321709+0000","last_undegraded":"2024-06-13T11:37:56.321709+0000","last_fullsized":"2024-06-13T11:37:56.321709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.323334+0000","last_change":"2024-06-13T11:37:55.313951+0000","last_active":"2024-06-13T11:37:56.323334+0000","last_peered":"2024-06-13T11:37:56.323334+0000","last_clean":"2024-06-13T11:37:56.323334+0000","last_became_active":"2024-06-13T11:37:55.313509+0000","last_became_peered":"2024-06-13T11:37:55.313509+0000","last_unstale":"2024-06-13T11:37:56.323334+0000","last_undegraded":"2024-06-13T11:37:56.323334+0000","last_fullsized":"2024-06-13T11:37:56.323334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:26.188457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336553+0000","last_change":"2024-06-13T11:37:56.333448+0000","last_active":"2024-06-13T11:37:56.336553+0000","last_peered":"2024-06-13T11:37:56.336553+0000","last_clean":"2024-06-13T11:37:56.336553+0000","last_became_active":"2024-06-13T11:37:56.332703+0000","last_became_peered":"2024-06-13T11:37:56.332703+0000","last_unstale":"2024-06-13T11:37:56.336553+0000","last_undegraded":"2024-06-13T11:37:56.336553+0000","last_fullsized":"2024-06-13T11:37:56.336553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306065+0000","last_change":"2024-06-13T11:37:55.310716+0000","last_active":"2024-06-13T11:37:56.306065+0000","last_peered":"2024-06-13T11:37:56.306065+0000","last_clean":"2024-06-13T11:37:56.306065+0000","last_became_active":"2024-06-13T11:37:55.310423+0000","last_became_peered":"2024-06-13T11:37:55.310423+0000","last_unstale":"2024-06-13T11:37:56.306065+0000","last_undegraded":"2024-06-13T11:37:56.306065+0000","last_fullsized":"2024-06-13T11:37:56.306065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:17:20.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324450+0000","last_change":"2024-06-13T11:37:56.323367+0000","last_active":"2024-06-13T11:37:56.324450+0000","last_peered":"2024-06-13T11:37:56.324450+0000","last_clean":"2024-06-13T11:37:56.324450+0000","last_became_active":"2024-06-13T11:37:56.323061+0000","last_became_peered":"2024-06-13T11:37:56.323061+0000","last_unstale":"2024-06-13T11:37:56.324450+0000","last_undegraded":"2024-06-13T11:37:56.324450+0000","last_fullsized":"2024-06-13T11:37:56.324450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:14:31.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315192+0000","last_change":"2024-06-13T11:37:55.316693+0000","last_active":"2024-06-13T11:37:56.315192+0000","last_peered":"2024-06-13T11:37:56.315192+0000","last_clean":"2024-06-13T11:37:56.315192+0000","last_became_active":"2024-06-13T11:37:55.316352+0000","last_became_peered":"2024-06-13T11:37:55.316352+0000","last_unstale":"2024-06-13T11:37:56.315192+0000","last_undegraded":"2024-06-13T11:37:56.315192+0000","last_fullsized":"2024-06-13T11:37:56.315192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332807+0000","last_change":"2024-06-13T11:37:56.330835+0000","last_active":"2024-06-13T11:37:56.332807+0000","last_peered":"2024-06-13T11:37:56.332807+0000","last_clean":"2024-06-13T11:37:56.332807+0000","last_became_active":"2024-06-13T11:37:56.330558+0000","last_became_peered":"2024-06-13T11:37:56.330558+0000","last_unstale":"2024-06-13T11:37:56.332807+0000","last_undegraded":"2024-06-13T11:37:56.332807+0000","last_fullsized":"2024-06-13T11:37:56.332807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314791+0000","last_change":"2024-06-13T11:37:55.317955+0000","last_active":"2024-06-13T11:37:56.314791+0000","last_peered":"2024-06-13T11:37:56.314791+0000","last_clean":"2024-06-13T11:37:56.314791+0000","last_became_active":"2024-06-13T11:37:55.317670+0000","last_became_peered":"2024-06-13T11:37:55.317670+0000","last_unstale":"2024-06-13T11:37:56.314791+0000","last_undegraded":"2024-06-13T11:37:56.314791+0000","last_fullsized":"2024-06-13T11:37:56.314791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:49.054318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328843+0000","last_change":"2024-06-13T11:37:56.327970+0000","last_active":"2024-06-13T11:37:56.328843+0000","last_peered":"2024-06-13T11:37:56.328843+0000","last_clean":"2024-06-13T11:37:56.328843+0000","last_became_active":"2024-06-13T11:37:56.327680+0000","last_became_peered":"2024-06-13T11:37:56.327680+0000","last_unstale":"2024-06-13T11:37:56.328843+0000","last_undegraded":"2024-06-13T11:37:56.328843+0000","last_fullsized":"2024-06-13T11:37:56.328843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.299492+0000","last_change":"2024-06-13T11:37:54.299492+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.299492+0000","last_undegraded":"2024-06-13T11:37:54.299492+0000","last_fullsized":"2024-06-13T11:37:54.299492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328974+0000","last_change":"2024-06-13T11:37:56.325514+0000","last_active":"2024-06-13T11:37:56.328974+0000","last_peered":"2024-06-13T11:37:56.328974+0000","last_clean":"2024-06-13T11:37:56.328974+0000","last_became_active":"2024-06-13T11:37:56.324920+0000","last_became_peered":"2024-06-13T11:37:56.324920+0000","last_unstale":"2024-06-13T11:37:56.328974+0000","last_undegraded":"2024-06-13T11:37:56.328974+0000","last_fullsized":"2024-06-13T11:37:56.328974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:22.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315670+0000","last_change":"2024-06-13T11:37:55.308637+0000","last_active":"2024-06-13T11:37:56.315670+0000","last_peered":"2024-06-13T11:37:56.315670+0000","last_clean":"2024-06-13T11:37:56.315670+0000","last_became_active":"2024-06-13T11:37:55.308361+0000","last_became_peered":"2024-06-13T11:37:55.308361+0000","last_unstale":"2024-06-13T11:37:56.315670+0000","last_undegraded":"2024-06-13T11:37:56.315670+0000","last_fullsized":"2024-06-13T11:37:56.315670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336100+0000","last_change":"2024-06-13T11:37:56.332842+0000","last_active":"2024-06-13T11:37:56.336100+0000","last_peered":"2024-06-13T11:37:56.336100+0000","last_clean":"2024-06-13T11:37:56.336100+0000","last_became_active":"2024-06-13T11:37:56.332557+0000","last_became_peered":"2024-06-13T11:37:56.332557+0000","last_unstale":"2024-06-13T11:37:56.336100+0000","last_undegraded":"2024-06-13T11:37:56.336100+0000","last_fullsized":"2024-06-13T11:37:56.336100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.310725+0000","last_change":"2024-06-13T11:37:55.315564+0000","last_active":"2024-06-13T11:37:56.310725+0000","last_peered":"2024-06-13T11:37:56.310725+0000","last_clean":"2024-06-13T11:37:56.310725+0000","last_became_active":"2024-06-13T11:37:55.313545+0000","last_became_peered":"2024-06-13T11:37:55.313545+0000","last_unstale":"2024-06-13T11:37:56.310725+0000","last_undegraded":"2024-06-13T11:37:56.310725+0000","last_fullsized":"2024-06-13T11:37:56.310725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:46.960127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322853+0000","last_change":"2024-06-13T11:37:56.319494+0000","last_active":"2024-06-13T11:37:56.322853+0000","last_peered":"2024-06-13T11:37:56.322853+0000","last_clean":"2024-06-13T11:37:56.322853+0000","last_became_active":"2024-06-13T11:37:56.319182+0000","last_became_peered":"2024-06-13T11:37:56.319182+0000","last_unstale":"2024-06-13T11:37:56.322853+0000","last_undegraded":"2024-06-13T11:37:56.322853+0000","last_fullsized":"2024-06-13T11:37:56.322853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320500+0000","last_change":"2024-06-13T11:37:55.318759+0000","last_active":"2024-06-13T11:37:56.320500+0000","last_peered":"2024-06-13T11:37:56.320500+0000","last_clean":"2024-06-13T11:37:56.320500+0000","last_became_active":"2024-06-13T11:37:55.318420+0000","last_became_peered":"2024-06-13T11:37:55.318420+0000","last_unstale":"2024-06-13T11:37:56.320500+0000","last_undegraded":"2024-06-13T11:37:56.320500+0000","last_fullsized":"2024-06-13T11:37:56.320500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:21.172360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319200+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:56.319200+0000","last_peered":"2024-06-13T11:37:56.319200+0000","last_clean":"2024-06-13T11:37:56.319200+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:56.319200+0000","last_undegraded":"2024-06-13T11:37:56.319200+0000","last_fullsized":"2024-06-13T11:37:56.319200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":172124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":152011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:38:00.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:38:00.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.479+0000 7f4fc1cbd640 1 Processor -- start 2024-06-13T11:38:00.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.479+0000 7f4fc1cbd640 1 -- start start 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fc1cbd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0718c0 0x7f4fbc0d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fc1cbd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4fbc0d0dd0 0x7f4fbc0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fc1cbd640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fbc071ea0 con 0x7f4fbc144d40 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fc1cbd640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f4fbc072180 con 0x7f4fbc0d0dd0 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fc1cbd640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc072460 con 0x7f4fbc0718c0 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fbb7fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4fbc144d40 0x7f4fbc072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37124/0 (socket says 172.21.15.43:37124) 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fbbfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4fbc0d0dd0 0x7f4fbc0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fbb7fe640 1 -- 172.21.15.43:0/2776069404 learned_addr learned my addr 172.21.15.43:0/2776069404 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.480+0000 7f4fbaffd640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0718c0 0x7f4fbc0d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fbbfff640 1 -- 172.21.15.43:0/2776069404 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0718c0 msgr2=0x7f4fbc0d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fbbfff640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0718c0 0x7f4fbc0d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fbbfff640 1 -- 172.21.15.43:0/2776069404 >> v1:172.21.15.43:6789/0 conn(0x7f4fbc144d40 legacy=0x7f4fbc072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fbbfff640 1 -- 172.21.15.43:0/2776069404 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc072740 con 0x7f4fbc0d0dd0 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fba7fc640 1 -- 172.21.15.43:0/2776069404 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727459341 0 0) 0x7f4fbc071ea0 con 0x7f4fbc144d40 2024-06-13T11:38:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fbaffd640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0718c0 0x7f4fbc0d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:38:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fbbfff640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc0d0dd0 0x7f4fbc0d1260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009d90 tx=0x7f4fb402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7802847ffa899058 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fba7fc640 1 -- 172.21.15.43:0/2776069404 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4031600 con 0x7f4fbc0d0dd0 2024-06-13T11:38:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.481+0000 7f4fba7fc640 1 -- 172.21.15.43:0/2776069404 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb40317a0 con 0x7f4fbc0d0dd0 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fba7fc640 1 -- 172.21.15.43:0/2776069404 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4031b70 con 0x7f4fbc0d0dd0 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/2776069404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc0d0dd0 msgr2=0x7f4fbc0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc0d0dd0 0x7f4fbc0d1260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009d90 tx=0x7f4fb402a5d0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/2776069404 shutdown_connections 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc0d0dd0 0x7f4fbc0d1260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/2776069404 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0718c0 0x7f4fbc0d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/2776069404 >> 172.21.15.43:0/2776069404 conn(0x7f4fbc070810 msgr2=0x7f4fbc070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/2776069404 shutdown_connections 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.482+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/2776069404 wait complete. 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.483+0000 7f4fc1cbd640 1 Processor -- start 2024-06-13T11:38:00.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.483+0000 7f4fc1cbd640 1 -- start start 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fc1cbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fbc0718c0 0x7f4fbc1f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fc1cbd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0d0dd0 0x7f4fbc136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fc1cbd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 0x7f4fbc1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fc1cbd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc145120 con 0x7f4fbc144d40 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fc1cbd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc0d05b0 con 0x7f4fbc0718c0 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fc1cbd640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc1387f0 con 0x7f4fbc0d0dd0 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 0x7f4fbc1382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 0x7f4fbc1382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55028/0 (socket says 172.21.15.43:55028) 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.484+0000 7f4fbbfff640 1 -- 172.21.15.43:0/1909414989 learned_addr learned my addr 172.21.15.43:0/1909414989 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbb7fe640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fbc0718c0 0x7f4fbc1f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbaffd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0d0dd0 0x7f4fbc136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbbfff640 1 -- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0d0dd0 msgr2=0x7f4fbc136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbbfff640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0d0dd0 0x7f4fbc136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbbfff640 1 -- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fbc0718c0 msgr2=0x7f4fbc1f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbbfff640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fbc0718c0 0x7f4fbc1f83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbbfff640 1 -- 172.21.15.43:0/1909414989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc13a180 con 0x7f4fbc144d40 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbb7fe640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fbc0718c0 0x7f4fbc1f83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fbbfff640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 0x7f4fbc1382b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009eb0 tx=0x7f4fb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4040070 con 0x7f4fbc144d40 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb4030be0 con 0x7f4fbc144d40 2024-06-13T11:38:00.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fbc13a460 con 0x7f4fbc144d40 2024-06-13T11:38:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4009450 con 0x7f4fbc144d40 2024-06-13T11:38:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.485+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fbc13aa20 con 0x7f4fbc144d40 2024-06-13T11:38:00.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.486+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc04ffb0 con 0x7f4fbc144d40 2024-06-13T11:38:00.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.486+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fb4039040 con 0x7f4fbc144d40 2024-06-13T11:38:00.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.487+0000 7f4fa3fff640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4fa806be30 0x7f4fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.487+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f4fb40abd50 con 0x7f4fbc144d40 2024-06-13T11:38:00.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.487+0000 7f4fbb7fe640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4fa806be30 0x7f4fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.488+0000 7f4fbb7fe640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4fa806be30 0x7f4fa806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4fac000f60 tx=0x7f4fac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.491+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4fb40af030 con 0x7f4fbc144d40 2024-06-13T11:38:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.673+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fbc13ac60 con 0x7f4fa806be30 2024-06-13T11:38:00.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.680+0000 7f4fa3fff640 1 -- 172.21.15.43:0/1909414989 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250712 (secure 0 0 0) 0x7f4fac001c90 con 0x7f4fa806be30 2024-06-13T11:38:00.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:00.683 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4fa806be30 msgr2=0x7f4fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4fa806be30 0x7f4fa806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4fac000f60 tx=0x7f4fac009040 comp rx=0 tx=0).stop 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 msgr2=0x7f4fbc1382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 0x7f4fbc1382b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009eb0 tx=0x7f4fb4004a40 comp rx=0 tx=0).stop 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 shutdown_connections 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f4fa806be30 0x7f4fa806e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fbc144d40 0x7f4fbc1382b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f4fbc0d0dd0 0x7f4fbc136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 --2- 172.21.15.43:0/1909414989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fbc0718c0 0x7f4fbc1f83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 >> 172.21.15.43:0/1909414989 conn(0x7f4fbc070810 msgr2=0x7f4fbc13edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:00.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 shutdown_connections 2024-06-13T11:38:00.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.683+0000 7f4fc1cbd640 1 -- 172.21.15.43:0/1909414989 wait complete. 2024-06-13T11:38:00.693 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-06-13T11:37:59.361045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253720,"kb_used_data":4256,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721000,"statfs":{"total":773094113280,"available":772834304000,"internally_reserved":0,"allocated":4358144,"data_stored":2494193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.067473"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324984+0000","last_change":"2024-06-13T11:37:56.323330+0000","last_active":"2024-06-13T11:37:56.324984+0000","last_peered":"2024-06-13T11:37:56.324984+0000","last_clean":"2024-06-13T11:37:56.324984+0000","last_became_active":"2024-06-13T11:37:56.323036+0000","last_became_peered":"2024-06-13T11:37:56.323036+0000","last_unstale":"2024-06-13T11:37:56.324984+0000","last_undegraded":"2024-06-13T11:37:56.324984+0000","last_fullsized":"2024-06-13T11:37:56.324984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:21:41.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.318958+0000","last_change":"2024-06-13T11:37:56.317705+0000","last_active":"2024-06-13T11:37:56.318958+0000","last_peered":"2024-06-13T11:37:56.318958+0000","last_clean":"2024-06-13T11:37:56.318958+0000","last_became_active":"2024-06-13T11:37:56.317411+0000","last_became_peered":"2024-06-13T11:37:56.317411+0000","last_unstale":"2024-06-13T11:37:56.318958+0000","last_undegraded":"2024-06-13T11:37:56.318958+0000","last_fullsized":"2024-06-13T11:37:56.318958+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332928+0000","last_change":"2024-06-13T11:37:56.331226+0000","last_active":"2024-06-13T11:37:56.332928+0000","last_peered":"2024-06-13T11:37:56.332928+0000","last_clean":"2024-06-13T11:37:56.332928+0000","last_became_active":"2024-06-13T11:37:56.330954+0000","last_became_peered":"2024-06-13T11:37:56.330954+0000","last_unstale":"2024-06-13T11:37:56.332928+0000","last_undegraded":"2024-06-13T11:37:56.332928+0000","last_fullsized":"2024-06-13T11:37:56.332928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333203+0000","last_change":"2024-06-13T11:37:56.328375+0000","last_active":"2024-06-13T11:37:56.333203+0000","last_peered":"2024-06-13T11:37:56.333203+0000","last_clean":"2024-06-13T11:37:56.333203+0000","last_became_active":"2024-06-13T11:37:56.327777+0000","last_became_peered":"2024-06-13T11:37:56.327777+0000","last_unstale":"2024-06-13T11:37:56.333203+0000","last_undegraded":"2024-06-13T11:37:56.333203+0000","last_fullsized":"2024-06-13T11:37:56.333203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:44.669303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333007+0000","last_change":"2024-06-13T11:37:56.330392+0000","last_active":"2024-06-13T11:37:56.333007+0000","last_peered":"2024-06-13T11:37:56.333007+0000","last_clean":"2024-06-13T11:37:56.333007+0000","last_became_active":"2024-06-13T11:37:56.330114+0000","last_became_peered":"2024-06-13T11:37:56.330114+0000","last_unstale":"2024-06-13T11:37:56.333007+0000","last_undegraded":"2024-06-13T11:37:56.333007+0000","last_fullsized":"2024-06-13T11:37:56.333007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:42.005975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320115+0000","last_change":"2024-06-13T11:37:56.316382+0000","last_active":"2024-06-13T11:37:56.320115+0000","last_peered":"2024-06-13T11:37:56.320115+0000","last_clean":"2024-06-13T11:37:56.320115+0000","last_became_active":"2024-06-13T11:37:56.316079+0000","last_became_peered":"2024-06-13T11:37:56.316079+0000","last_unstale":"2024-06-13T11:37:56.320115+0000","last_undegraded":"2024-06-13T11:37:56.320115+0000","last_fullsized":"2024-06-13T11:37:56.320115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322531+0000","last_change":"2024-06-13T11:37:56.320153+0000","last_active":"2024-06-13T11:37:56.322531+0000","last_peered":"2024-06-13T11:37:56.322531+0000","last_clean":"2024-06-13T11:37:56.322531+0000","last_became_active":"2024-06-13T11:37:56.319164+0000","last_became_peered":"2024-06-13T11:37:56.319164+0000","last_unstale":"2024-06-13T11:37:56.322531+0000","last_undegraded":"2024-06-13T11:37:56.322531+0000","last_fullsized":"2024-06-13T11:37:56.322531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333612+0000","last_change":"2024-06-13T11:37:56.329963+0000","last_active":"2024-06-13T11:37:56.333612+0000","last_peered":"2024-06-13T11:37:56.333612+0000","last_clean":"2024-06-13T11:37:56.333612+0000","last_became_active":"2024-06-13T11:37:56.329661+0000","last_became_peered":"2024-06-13T11:37:56.329661+0000","last_unstale":"2024-06-13T11:37:56.333612+0000","last_undegraded":"2024-06-13T11:37:56.333612+0000","last_fullsized":"2024-06-13T11:37:56.333612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:33:06.820994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326642+0000","last_change":"2024-06-13T11:37:56.323714+0000","last_active":"2024-06-13T11:37:56.326642+0000","last_peered":"2024-06-13T11:37:56.326642+0000","last_clean":"2024-06-13T11:37:56.326642+0000","last_became_active":"2024-06-13T11:37:56.323416+0000","last_became_peered":"2024-06-13T11:37:56.323416+0000","last_unstale":"2024-06-13T11:37:56.326642+0000","last_undegraded":"2024-06-13T11:37:56.326642+0000","last_fullsized":"2024-06-13T11:37:56.326642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:20.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.330128+0000","last_change":"2024-06-13T11:37:56.326263+0000","last_active":"2024-06-13T11:37:56.330128+0000","last_peered":"2024-06-13T11:37:56.330128+0000","last_clean":"2024-06-13T11:37:56.330128+0000","last_became_active":"2024-06-13T11:37:56.325928+0000","last_became_peered":"2024-06-13T11:37:56.325928+0000","last_unstale":"2024-06-13T11:37:56.330128+0000","last_undegraded":"2024-06-13T11:37:56.330128+0000","last_fullsized":"2024-06-13T11:37:56.330128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:28.052669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335071+0000","last_change":"2024-06-13T11:37:56.328875+0000","last_active":"2024-06-13T11:37:56.335071+0000","last_peered":"2024-06-13T11:37:56.335071+0000","last_clean":"2024-06-13T11:37:56.335071+0000","last_became_active":"2024-06-13T11:37:56.328466+0000","last_became_peered":"2024-06-13T11:37:56.328466+0000","last_unstale":"2024-06-13T11:37:56.335071+0000","last_undegraded":"2024-06-13T11:37:56.335071+0000","last_fullsized":"2024-06-13T11:37:56.335071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:32:34.940913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332760+0000","last_change":"2024-06-13T11:37:56.329293+0000","last_active":"2024-06-13T11:37:56.332760+0000","last_peered":"2024-06-13T11:37:56.332760+0000","last_clean":"2024-06-13T11:37:56.332760+0000","last_became_active":"2024-06-13T11:37:56.329023+0000","last_became_peered":"2024-06-13T11:37:56.329023+0000","last_unstale":"2024-06-13T11:37:56.332760+0000","last_undegraded":"2024-06-13T11:37:56.332760+0000","last_fullsized":"2024-06-13T11:37:56.332760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331363+0000","last_change":"2024-06-13T11:37:56.327065+0000","last_active":"2024-06-13T11:37:56.331363+0000","last_peered":"2024-06-13T11:37:56.331363+0000","last_clean":"2024-06-13T11:37:56.331363+0000","last_became_active":"2024-06-13T11:37:56.326677+0000","last_became_peered":"2024-06-13T11:37:56.326677+0000","last_unstale":"2024-06-13T11:37:56.331363+0000","last_undegraded":"2024-06-13T11:37:56.331363+0000","last_fullsized":"2024-06-13T11:37:56.331363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:53.607284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336028+0000","last_change":"2024-06-13T11:37:56.333377+0000","last_active":"2024-06-13T11:37:56.336028+0000","last_peered":"2024-06-13T11:37:56.336028+0000","last_clean":"2024-06-13T11:37:56.336028+0000","last_became_active":"2024-06-13T11:37:56.333061+0000","last_became_peered":"2024-06-13T11:37:56.333061+0000","last_unstale":"2024-06-13T11:37:56.336028+0000","last_undegraded":"2024-06-13T11:37:56.336028+0000","last_fullsized":"2024-06-13T11:37:56.336028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322572+0000","last_change":"2024-06-13T11:37:56.320422+0000","last_active":"2024-06-13T11:37:56.322572+0000","last_peered":"2024-06-13T11:37:56.322572+0000","last_clean":"2024-06-13T11:37:56.322572+0000","last_became_active":"2024-06-13T11:37:56.319882+0000","last_became_peered":"2024-06-13T11:37:56.319882+0000","last_unstale":"2024-06-13T11:37:56.322572+0000","last_undegraded":"2024-06-13T11:37:56.322572+0000","last_fullsized":"2024-06-13T11:37:56.322572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:57:21.388732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338304+0000","last_change":"2024-06-13T11:37:56.337108+0000","last_active":"2024-06-13T11:37:56.338304+0000","last_peered":"2024-06-13T11:37:56.338304+0000","last_clean":"2024-06-13T11:37:56.338304+0000","last_became_active":"2024-06-13T11:37:56.336726+0000","last_became_peered":"2024-06-13T11:37:56.336726+0000","last_unstale":"2024-06-13T11:37:56.338304+0000","last_undegraded":"2024-06-13T11:37:56.338304+0000","last_fullsized":"2024-06-13T11:37:56.338304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338335+0000","last_change":"2024-06-13T11:37:56.336965+0000","last_active":"2024-06-13T11:37:56.338335+0000","last_peered":"2024-06-13T11:37:56.338335+0000","last_clean":"2024-06-13T11:37:56.338335+0000","last_became_active":"2024-06-13T11:37:56.336655+0000","last_became_peered":"2024-06-13T11:37:56.336655+0000","last_unstale":"2024-06-13T11:37:56.338335+0000","last_undegraded":"2024-06-13T11:37:56.338335+0000","last_fullsized":"2024-06-13T11:37:56.338335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322566+0000","last_change":"2024-06-13T11:37:56.317302+0000","last_active":"2024-06-13T11:37:56.322566+0000","last_peered":"2024-06-13T11:37:56.322566+0000","last_clean":"2024-06-13T11:37:56.322566+0000","last_became_active":"2024-06-13T11:37:56.316660+0000","last_became_peered":"2024-06-13T11:37:56.316660+0000","last_unstale":"2024-06-13T11:37:56.322566+0000","last_undegraded":"2024-06-13T11:37:56.322566+0000","last_fullsized":"2024-06-13T11:37:56.322566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:41:42.438398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322585+0000","last_change":"2024-06-13T11:37:56.320203+0000","last_active":"2024-06-13T11:37:56.322585+0000","last_peered":"2024-06-13T11:37:56.322585+0000","last_clean":"2024-06-13T11:37:56.322585+0000","last_became_active":"2024-06-13T11:37:56.319914+0000","last_became_peered":"2024-06-13T11:37:56.319914+0000","last_unstale":"2024-06-13T11:37:56.322585+0000","last_undegraded":"2024-06-13T11:37:56.322585+0000","last_fullsized":"2024-06-13T11:37:56.322585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:34.553237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331239+0000","last_change":"2024-06-13T11:37:56.328768+0000","last_active":"2024-06-13T11:37:56.331239+0000","last_peered":"2024-06-13T11:37:56.331239+0000","last_clean":"2024-06-13T11:37:56.331239+0000","last_became_active":"2024-06-13T11:37:56.328430+0000","last_became_peered":"2024-06-13T11:37:56.328430+0000","last_unstale":"2024-06-13T11:37:56.331239+0000","last_undegraded":"2024-06-13T11:37:56.331239+0000","last_fullsized":"2024-06-13T11:37:56.331239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336588+0000","last_change":"2024-06-13T11:37:56.333430+0000","last_active":"2024-06-13T11:37:56.336588+0000","last_peered":"2024-06-13T11:37:56.336588+0000","last_clean":"2024-06-13T11:37:56.336588+0000","last_became_active":"2024-06-13T11:37:56.333164+0000","last_became_peered":"2024-06-13T11:37:56.333164+0000","last_unstale":"2024-06-13T11:37:56.336588+0000","last_undegraded":"2024-06-13T11:37:56.336588+0000","last_fullsized":"2024-06-13T11:37:56.336588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328011+0000","last_change":"2024-06-13T11:37:56.326591+0000","last_active":"2024-06-13T11:37:56.328011+0000","last_peered":"2024-06-13T11:37:56.328011+0000","last_clean":"2024-06-13T11:37:56.328011+0000","last_became_active":"2024-06-13T11:37:56.326263+0000","last_became_peered":"2024-06-13T11:37:56.326263+0000","last_unstale":"2024-06-13T11:37:56.328011+0000","last_undegraded":"2024-06-13T11:37:56.328011+0000","last_fullsized":"2024-06-13T11:37:56.328011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:04:39.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.327272+0000","last_change":"2024-06-13T11:37:56.325540+0000","last_active":"2024-06-13T11:37:56.327272+0000","last_peered":"2024-06-13T11:37:56.327272+0000","last_clean":"2024-06-13T11:37:56.327272+0000","last_became_active":"2024-06-13T11:37:56.325219+0000","last_became_peered":"2024-06-13T11:37:56.325219+0000","last_unstale":"2024-06-13T11:37:56.327272+0000","last_undegraded":"2024-06-13T11:37:56.327272+0000","last_fullsized":"2024-06-13T11:37:56.327272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328276+0000","last_change":"2024-06-13T11:37:56.323559+0000","last_active":"2024-06-13T11:37:56.328276+0000","last_peered":"2024-06-13T11:37:56.328276+0000","last_clean":"2024-06-13T11:37:56.328276+0000","last_became_active":"2024-06-13T11:37:56.323291+0000","last_became_peered":"2024-06-13T11:37:56.323291+0000","last_unstale":"2024-06-13T11:37:56.328276+0000","last_undegraded":"2024-06-13T11:37:56.328276+0000","last_fullsized":"2024-06-13T11:37:56.328276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:38:46.544540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336610+0000","last_change":"2024-06-13T11:37:56.334243+0000","last_active":"2024-06-13T11:37:56.336610+0000","last_peered":"2024-06-13T11:37:56.336610+0000","last_clean":"2024-06-13T11:37:56.336610+0000","last_became_active":"2024-06-13T11:37:56.333952+0000","last_became_peered":"2024-06-13T11:37:56.333952+0000","last_unstale":"2024-06-13T11:37:56.336610+0000","last_undegraded":"2024-06-13T11:37:56.336610+0000","last_fullsized":"2024-06-13T11:37:56.336610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321475+0000","last_change":"2024-06-13T11:37:56.318049+0000","last_active":"2024-06-13T11:37:56.321475+0000","last_peered":"2024-06-13T11:37:56.321475+0000","last_clean":"2024-06-13T11:37:56.321475+0000","last_became_active":"2024-06-13T11:37:56.317769+0000","last_became_peered":"2024-06-13T11:37:56.317769+0000","last_unstale":"2024-06-13T11:37:56.321475+0000","last_undegraded":"2024-06-13T11:37:56.321475+0000","last_fullsized":"2024-06-13T11:37:56.321475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338431+0000","last_change":"2024-06-13T11:37:56.336846+0000","last_active":"2024-06-13T11:37:56.338431+0000","last_peered":"2024-06-13T11:37:56.338431+0000","last_clean":"2024-06-13T11:37:56.338431+0000","last_became_active":"2024-06-13T11:37:56.336555+0000","last_became_peered":"2024-06-13T11:37:56.336555+0000","last_unstale":"2024-06-13T11:37:56.338431+0000","last_undegraded":"2024-06-13T11:37:56.338431+0000","last_fullsized":"2024-06-13T11:37:56.338431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.300009+0000","last_change":"2024-06-13T11:37:54.300009+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.300009+0000","last_undegraded":"2024-06-13T11:37:54.300009+0000","last_fullsized":"2024-06-13T11:37:54.300009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332783+0000","last_change":"2024-06-13T11:37:56.330952+0000","last_active":"2024-06-13T11:37:56.332783+0000","last_peered":"2024-06-13T11:37:56.332783+0000","last_clean":"2024-06-13T11:37:56.332783+0000","last_became_active":"2024-06-13T11:37:56.330604+0000","last_became_peered":"2024-06-13T11:37:56.330604+0000","last_unstale":"2024-06-13T11:37:56.332783+0000","last_undegraded":"2024-06-13T11:37:56.332783+0000","last_fullsized":"2024-06-13T11:37:56.332783+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337848+0000","last_change":"2024-06-13T11:37:55.319411+0000","last_active":"2024-06-13T11:37:56.337848+0000","last_peered":"2024-06-13T11:37:56.337848+0000","last_clean":"2024-06-13T11:37:56.337848+0000","last_became_active":"2024-06-13T11:37:55.318305+0000","last_became_peered":"2024-06-13T11:37:55.318305+0000","last_unstale":"2024-06-13T11:37:56.337848+0000","last_undegraded":"2024-06-13T11:37:56.337848+0000","last_fullsized":"2024-06-13T11:37:56.337848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:15:12.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337375+0000","last_change":"2024-06-13T11:37:56.334255+0000","last_active":"2024-06-13T11:37:56.337375+0000","last_peered":"2024-06-13T11:37:56.337375+0000","last_clean":"2024-06-13T11:37:56.337375+0000","last_became_active":"2024-06-13T11:37:56.333761+0000","last_became_peered":"2024-06-13T11:37:56.333761+0000","last_unstale":"2024-06-13T11:37:56.337375+0000","last_undegraded":"2024-06-13T11:37:56.337375+0000","last_fullsized":"2024-06-13T11:37:56.337375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324180+0000","last_change":"2024-06-13T11:37:55.318481+0000","last_active":"2024-06-13T11:37:56.324180+0000","last_peered":"2024-06-13T11:37:56.324180+0000","last_clean":"2024-06-13T11:37:56.324180+0000","last_became_active":"2024-06-13T11:37:55.318164+0000","last_became_peered":"2024-06-13T11:37:55.318164+0000","last_unstale":"2024-06-13T11:37:56.324180+0000","last_undegraded":"2024-06-13T11:37:56.324180+0000","last_fullsized":"2024-06-13T11:37:56.324180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:33.823945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319390+0000","last_change":"2024-06-13T11:37:56.318534+0000","last_active":"2024-06-13T11:37:56.319390+0000","last_peered":"2024-06-13T11:37:56.319390+0000","last_clean":"2024-06-13T11:37:56.319390+0000","last_became_active":"2024-06-13T11:37:56.318248+0000","last_became_peered":"2024-06-13T11:37:56.318248+0000","last_unstale":"2024-06-13T11:37:56.319390+0000","last_undegraded":"2024-06-13T11:37:56.319390+0000","last_fullsized":"2024-06-13T11:37:56.319390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:24.453927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335250+0000","last_change":"2024-06-13T11:37:55.308705+0000","last_active":"2024-06-13T11:37:56.335250+0000","last_peered":"2024-06-13T11:37:56.335250+0000","last_clean":"2024-06-13T11:37:56.335250+0000","last_became_active":"2024-06-13T11:37:55.308399+0000","last_became_peered":"2024-06-13T11:37:55.308399+0000","last_unstale":"2024-06-13T11:37:56.335250+0000","last_undegraded":"2024-06-13T11:37:56.335250+0000","last_fullsized":"2024-06-13T11:37:56.335250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326916+0000","last_change":"2024-06-13T11:37:56.325979+0000","last_active":"2024-06-13T11:37:56.326916+0000","last_peered":"2024-06-13T11:37:56.326916+0000","last_clean":"2024-06-13T11:37:56.326916+0000","last_became_active":"2024-06-13T11:37:56.325682+0000","last_became_peered":"2024-06-13T11:37:56.325682+0000","last_unstale":"2024-06-13T11:37:56.326916+0000","last_undegraded":"2024-06-13T11:37:56.326916+0000","last_fullsized":"2024-06-13T11:37:56.326916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:34.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326923+0000","last_change":"2024-06-13T11:37:55.314283+0000","last_active":"2024-06-13T11:37:56.326923+0000","last_peered":"2024-06-13T11:37:56.326923+0000","last_clean":"2024-06-13T11:37:56.326923+0000","last_became_active":"2024-06-13T11:37:55.313981+0000","last_became_peered":"2024-06-13T11:37:55.313981+0000","last_unstale":"2024-06-13T11:37:56.326923+0000","last_undegraded":"2024-06-13T11:37:56.326923+0000","last_fullsized":"2024-06-13T11:37:56.326923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:32.867795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322553+0000","last_change":"2024-06-13T11:37:56.320173+0000","last_active":"2024-06-13T11:37:56.322553+0000","last_peered":"2024-06-13T11:37:56.322553+0000","last_clean":"2024-06-13T11:37:56.322553+0000","last_became_active":"2024-06-13T11:37:56.319550+0000","last_became_peered":"2024-06-13T11:37:56.319550+0000","last_unstale":"2024-06-13T11:37:56.322553+0000","last_undegraded":"2024-06-13T11:37:56.322553+0000","last_fullsized":"2024-06-13T11:37:56.322553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337594+0000","last_change":"2024-06-13T11:37:55.319302+0000","last_active":"2024-06-13T11:37:56.337594+0000","last_peered":"2024-06-13T11:37:56.337594+0000","last_clean":"2024-06-13T11:37:56.337594+0000","last_became_active":"2024-06-13T11:37:55.318884+0000","last_became_peered":"2024-06-13T11:37:55.318884+0000","last_unstale":"2024-06-13T11:37:56.337594+0000","last_undegraded":"2024-06-13T11:37:56.337594+0000","last_fullsized":"2024-06-13T11:37:56.337594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328993+0000","last_change":"2024-06-13T11:37:56.325772+0000","last_active":"2024-06-13T11:37:56.328993+0000","last_peered":"2024-06-13T11:37:56.328993+0000","last_clean":"2024-06-13T11:37:56.328993+0000","last_became_active":"2024-06-13T11:37:56.325245+0000","last_became_peered":"2024-06-13T11:37:56.325245+0000","last_unstale":"2024-06-13T11:37:56.328993+0000","last_undegraded":"2024-06-13T11:37:56.328993+0000","last_fullsized":"2024-06-13T11:37:56.328993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313464+0000","last_change":"2024-06-13T11:37:55.312037+0000","last_active":"2024-06-13T11:37:56.313464+0000","last_peered":"2024-06-13T11:37:56.313464+0000","last_clean":"2024-06-13T11:37:56.313464+0000","last_became_active":"2024-06-13T11:37:55.311676+0000","last_became_peered":"2024-06-13T11:37:55.311676+0000","last_unstale":"2024-06-13T11:37:56.313464+0000","last_undegraded":"2024-06-13T11:37:56.313464+0000","last_fullsized":"2024-06-13T11:37:56.313464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333571+0000","last_change":"2024-06-13T11:37:56.331802+0000","last_active":"2024-06-13T11:37:56.333571+0000","last_peered":"2024-06-13T11:37:56.333571+0000","last_clean":"2024-06-13T11:37:56.333571+0000","last_became_active":"2024-06-13T11:37:56.331443+0000","last_became_peered":"2024-06-13T11:37:56.331443+0000","last_unstale":"2024-06-13T11:37:56.333571+0000","last_undegraded":"2024-06-13T11:37:56.333571+0000","last_fullsized":"2024-06-13T11:37:56.333571+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:22.710612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314234+0000","last_change":"2024-06-13T11:37:55.309937+0000","last_active":"2024-06-13T11:37:56.314234+0000","last_peered":"2024-06-13T11:37:56.314234+0000","last_clean":"2024-06-13T11:37:56.314234+0000","last_became_active":"2024-06-13T11:37:55.309677+0000","last_became_peered":"2024-06-13T11:37:55.309677+0000","last_unstale":"2024-06-13T11:37:56.314234+0000","last_undegraded":"2024-06-13T11:37:56.314234+0000","last_fullsized":"2024-06-13T11:37:56.314234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:06:17.518923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333134+0000","last_change":"2024-06-13T11:37:56.328114+0000","last_active":"2024-06-13T11:37:56.333134+0000","last_peered":"2024-06-13T11:37:56.333134+0000","last_clean":"2024-06-13T11:37:56.333134+0000","last_became_active":"2024-06-13T11:37:56.327404+0000","last_became_peered":"2024-06-13T11:37:56.327404+0000","last_unstale":"2024-06-13T11:37:56.333134+0000","last_undegraded":"2024-06-13T11:37:56.333134+0000","last_fullsized":"2024-06-13T11:37:56.333134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:47.251555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.311070+0000","last_change":"2024-06-13T11:37:55.317546+0000","last_active":"2024-06-13T11:37:56.311070+0000","last_peered":"2024-06-13T11:37:56.311070+0000","last_clean":"2024-06-13T11:37:56.311070+0000","last_became_active":"2024-06-13T11:37:55.317278+0000","last_became_peered":"2024-06-13T11:37:55.317278+0000","last_unstale":"2024-06-13T11:37:56.311070+0000","last_undegraded":"2024-06-13T11:37:56.311070+0000","last_fullsized":"2024-06-13T11:37:56.311070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:57.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336574+0000","last_change":"2024-06-13T11:37:56.333326+0000","last_active":"2024-06-13T11:37:56.336574+0000","last_peered":"2024-06-13T11:37:56.336574+0000","last_clean":"2024-06-13T11:37:56.336574+0000","last_became_active":"2024-06-13T11:37:56.332950+0000","last_became_peered":"2024-06-13T11:37:56.332950+0000","last_unstale":"2024-06-13T11:37:56.336574+0000","last_undegraded":"2024-06-13T11:37:56.336574+0000","last_fullsized":"2024-06-13T11:37:56.336574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.309602+0000","last_change":"2024-06-13T11:37:55.313056+0000","last_active":"2024-06-13T11:37:56.309602+0000","last_peered":"2024-06-13T11:37:56.309602+0000","last_clean":"2024-06-13T11:37:56.309602+0000","last_became_active":"2024-06-13T11:37:55.312782+0000","last_became_peered":"2024-06-13T11:37:55.312782+0000","last_unstale":"2024-06-13T11:37:56.309602+0000","last_undegraded":"2024-06-13T11:37:56.309602+0000","last_fullsized":"2024-06-13T11:37:56.309602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:06.789673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336735+0000","last_change":"2024-06-13T11:37:56.335836+0000","last_active":"2024-06-13T11:37:56.336735+0000","last_peered":"2024-06-13T11:37:56.336735+0000","last_clean":"2024-06-13T11:37:56.336735+0000","last_became_active":"2024-06-13T11:37:56.335541+0000","last_became_peered":"2024-06-13T11:37:56.335541+0000","last_unstale":"2024-06-13T11:37:56.336735+0000","last_undegraded":"2024-06-13T11:37:56.336735+0000","last_fullsized":"2024-06-13T11:37:56.336735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335147+0000","last_change":"2024-06-13T11:37:55.312146+0000","last_active":"2024-06-13T11:37:56.335147+0000","last_peered":"2024-06-13T11:37:56.335147+0000","last_clean":"2024-06-13T11:37:56.335147+0000","last_became_active":"2024-06-13T11:37:55.311692+0000","last_became_peered":"2024-06-13T11:37:55.311692+0000","last_unstale":"2024-06-13T11:37:56.335147+0000","last_undegraded":"2024-06-13T11:37:56.335147+0000","last_fullsized":"2024-06-13T11:37:56.335147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:52.165608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331247+0000","last_change":"2024-06-13T11:37:56.328733+0000","last_active":"2024-06-13T11:37:56.331247+0000","last_peered":"2024-06-13T11:37:56.331247+0000","last_clean":"2024-06-13T11:37:56.331247+0000","last_became_active":"2024-06-13T11:37:56.328353+0000","last_became_peered":"2024-06-13T11:37:56.328353+0000","last_unstale":"2024-06-13T11:37:56.331247+0000","last_undegraded":"2024-06-13T11:37:56.331247+0000","last_fullsized":"2024-06-13T11:37:56.331247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339092+0000","last_change":"2024-06-13T11:37:55.309442+0000","last_active":"2024-06-13T11:37:56.339092+0000","last_peered":"2024-06-13T11:37:56.339092+0000","last_clean":"2024-06-13T11:37:56.339092+0000","last_became_active":"2024-06-13T11:37:55.309109+0000","last_became_peered":"2024-06-13T11:37:55.309109+0000","last_unstale":"2024-06-13T11:37:56.339092+0000","last_undegraded":"2024-06-13T11:37:56.339092+0000","last_fullsized":"2024-06-13T11:37:56.339092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:55.069527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326115+0000","last_change":"2024-06-13T11:37:56.323618+0000","last_active":"2024-06-13T11:37:56.326115+0000","last_peered":"2024-06-13T11:37:56.326115+0000","last_clean":"2024-06-13T11:37:56.326115+0000","last_became_active":"2024-06-13T11:37:56.323333+0000","last_became_peered":"2024-06-13T11:37:56.323333+0000","last_unstale":"2024-06-13T11:37:56.326115+0000","last_undegraded":"2024-06-13T11:37:56.326115+0000","last_fullsized":"2024-06-13T11:37:56.326115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:39.954448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333494+0000","last_change":"2024-06-13T11:37:55.316960+0000","last_active":"2024-06-13T11:37:56.333494+0000","last_peered":"2024-06-13T11:37:56.333494+0000","last_clean":"2024-06-13T11:37:56.333494+0000","last_became_active":"2024-06-13T11:37:55.316663+0000","last_became_peered":"2024-06-13T11:37:55.316663+0000","last_unstale":"2024-06-13T11:37:56.333494+0000","last_undegraded":"2024-06-13T11:37:56.333494+0000","last_fullsized":"2024-06-13T11:37:56.333494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:06.986712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334322+0000","last_change":"2024-06-13T11:37:56.327997+0000","last_active":"2024-06-13T11:37:56.334322+0000","last_peered":"2024-06-13T11:37:56.334322+0000","last_clean":"2024-06-13T11:37:56.334322+0000","last_became_active":"2024-06-13T11:37:56.327722+0000","last_became_peered":"2024-06-13T11:37:56.327722+0000","last_unstale":"2024-06-13T11:37:56.334322+0000","last_undegraded":"2024-06-13T11:37:56.334322+0000","last_fullsized":"2024-06-13T11:37:56.334322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:58:30.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313590+0000","last_change":"2024-06-13T11:37:55.310340+0000","last_active":"2024-06-13T11:37:56.313590+0000","last_peered":"2024-06-13T11:37:56.313590+0000","last_clean":"2024-06-13T11:37:56.313590+0000","last_became_active":"2024-06-13T11:37:55.310063+0000","last_became_peered":"2024-06-13T11:37:55.310063+0000","last_unstale":"2024-06-13T11:37:56.313590+0000","last_undegraded":"2024-06-13T11:37:56.313590+0000","last_fullsized":"2024-06-13T11:37:56.313590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:38.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336464+0000","last_change":"2024-06-13T11:37:56.333319+0000","last_active":"2024-06-13T11:37:56.336464+0000","last_peered":"2024-06-13T11:37:56.336464+0000","last_clean":"2024-06-13T11:37:56.336464+0000","last_became_active":"2024-06-13T11:37:56.333028+0000","last_became_peered":"2024-06-13T11:37:56.333028+0000","last_unstale":"2024-06-13T11:37:56.336464+0000","last_undegraded":"2024-06-13T11:37:56.336464+0000","last_fullsized":"2024-06-13T11:37:56.336464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.299520+0000","last_change":"2024-06-13T11:37:54.299520+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.299520+0000","last_undegraded":"2024-06-13T11:37:54.299520+0000","last_fullsized":"2024-06-13T11:37:54.299520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333552+0000","last_change":"2024-06-13T11:37:56.330323+0000","last_active":"2024-06-13T11:37:56.333552+0000","last_peered":"2024-06-13T11:37:56.333552+0000","last_clean":"2024-06-13T11:37:56.333552+0000","last_became_active":"2024-06-13T11:37:56.330008+0000","last_became_peered":"2024-06-13T11:37:56.330008+0000","last_unstale":"2024-06-13T11:37:56.333552+0000","last_undegraded":"2024-06-13T11:37:56.333552+0000","last_fullsized":"2024-06-13T11:37:56.333552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:41:16.066555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339466+0000","last_change":"2024-06-13T11:37:55.317870+0000","last_active":"2024-06-13T11:37:56.339466+0000","last_peered":"2024-06-13T11:37:56.339466+0000","last_clean":"2024-06-13T11:37:56.339466+0000","last_became_active":"2024-06-13T11:37:55.317569+0000","last_became_peered":"2024-06-13T11:37:55.317569+0000","last_unstale":"2024-06-13T11:37:56.339466+0000","last_undegraded":"2024-06-13T11:37:56.339466+0000","last_fullsized":"2024-06-13T11:37:56.339466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320986+0000","last_change":"2024-06-13T11:37:56.318768+0000","last_active":"2024-06-13T11:37:56.320986+0000","last_peered":"2024-06-13T11:37:56.320986+0000","last_clean":"2024-06-13T11:37:56.320986+0000","last_became_active":"2024-06-13T11:37:56.318414+0000","last_became_peered":"2024-06-13T11:37:56.318414+0000","last_unstale":"2024-06-13T11:37:56.320986+0000","last_undegraded":"2024-06-13T11:37:56.320986+0000","last_fullsized":"2024-06-13T11:37:56.320986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:43.606286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.325219+0000","last_change":"2024-06-13T11:37:55.314832+0000","last_active":"2024-06-13T11:37:56.325219+0000","last_peered":"2024-06-13T11:37:56.325219+0000","last_clean":"2024-06-13T11:37:56.325219+0000","last_became_active":"2024-06-13T11:37:55.314553+0000","last_became_peered":"2024-06-13T11:37:55.314553+0000","last_unstale":"2024-06-13T11:37:56.325219+0000","last_undegraded":"2024-06-13T11:37:56.325219+0000","last_fullsized":"2024-06-13T11:37:56.325219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:33.732710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335202+0000","last_change":"2024-06-13T11:37:56.329960+0000","last_active":"2024-06-13T11:37:56.335202+0000","last_peered":"2024-06-13T11:37:56.335202+0000","last_clean":"2024-06-13T11:37:56.335202+0000","last_became_active":"2024-06-13T11:37:56.327480+0000","last_became_peered":"2024-06-13T11:37:56.327480+0000","last_unstale":"2024-06-13T11:37:56.335202+0000","last_undegraded":"2024-06-13T11:37:56.335202+0000","last_fullsized":"2024-06-13T11:37:56.335202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:45.975185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332385+0000","last_change":"2024-06-13T11:37:55.310530+0000","last_active":"2024-06-13T11:37:56.332385+0000","last_peered":"2024-06-13T11:37:56.332385+0000","last_clean":"2024-06-13T11:37:56.332385+0000","last_became_active":"2024-06-13T11:37:55.310267+0000","last_became_peered":"2024-06-13T11:37:55.310267+0000","last_unstale":"2024-06-13T11:37:56.332385+0000","last_undegraded":"2024-06-13T11:37:56.332385+0000","last_fullsized":"2024-06-13T11:37:56.332385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333960+0000","last_change":"2024-06-13T11:37:56.330670+0000","last_active":"2024-06-13T11:37:56.333960+0000","last_peered":"2024-06-13T11:37:56.333960+0000","last_clean":"2024-06-13T11:37:56.333960+0000","last_became_active":"2024-06-13T11:37:56.330391+0000","last_became_peered":"2024-06-13T11:37:56.330391+0000","last_unstale":"2024-06-13T11:37:56.333960+0000","last_undegraded":"2024-06-13T11:37:56.333960+0000","last_fullsized":"2024-06-13T11:37:56.333960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334822+0000","last_change":"2024-06-13T11:37:55.315973+0000","last_active":"2024-06-13T11:37:56.334822+0000","last_peered":"2024-06-13T11:37:56.334822+0000","last_clean":"2024-06-13T11:37:56.334822+0000","last_became_active":"2024-06-13T11:37:55.315613+0000","last_became_peered":"2024-06-13T11:37:55.315613+0000","last_unstale":"2024-06-13T11:37:56.334822+0000","last_undegraded":"2024-06-13T11:37:56.334822+0000","last_fullsized":"2024-06-13T11:37:56.334822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:39:13.330192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322587+0000","last_change":"2024-06-13T11:37:56.317844+0000","last_active":"2024-06-13T11:37:56.322587+0000","last_peered":"2024-06-13T11:37:56.322587+0000","last_clean":"2024-06-13T11:37:56.322587+0000","last_became_active":"2024-06-13T11:37:56.317533+0000","last_became_peered":"2024-06-13T11:37:56.317533+0000","last_unstale":"2024-06-13T11:37:56.322587+0000","last_undegraded":"2024-06-13T11:37:56.322587+0000","last_fullsized":"2024-06-13T11:37:56.322587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:20.305235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313660+0000","last_change":"2024-06-13T11:37:55.317261+0000","last_active":"2024-06-13T11:37:56.313660+0000","last_peered":"2024-06-13T11:37:56.313660+0000","last_clean":"2024-06-13T11:37:56.313660+0000","last_became_active":"2024-06-13T11:37:55.316983+0000","last_became_peered":"2024-06-13T11:37:55.316983+0000","last_unstale":"2024-06-13T11:37:56.313660+0000","last_undegraded":"2024-06-13T11:37:56.313660+0000","last_fullsized":"2024-06-13T11:37:56.313660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:19.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336402+0000","last_change":"2024-06-13T11:37:56.332777+0000","last_active":"2024-06-13T11:37:56.336402+0000","last_peered":"2024-06-13T11:37:56.336402+0000","last_clean":"2024-06-13T11:37:56.336402+0000","last_became_active":"2024-06-13T11:37:56.332287+0000","last_became_peered":"2024-06-13T11:37:56.332287+0000","last_unstale":"2024-06-13T11:37:56.336402+0000","last_undegraded":"2024-06-13T11:37:56.336402+0000","last_fullsized":"2024-06-13T11:37:56.336402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335535+0000","last_change":"2024-06-13T11:37:55.318031+0000","last_active":"2024-06-13T11:37:56.335535+0000","last_peered":"2024-06-13T11:37:56.335535+0000","last_clean":"2024-06-13T11:37:56.335535+0000","last_became_active":"2024-06-13T11:37:55.316716+0000","last_became_peered":"2024-06-13T11:37:55.316716+0000","last_unstale":"2024-06-13T11:37:56.335535+0000","last_undegraded":"2024-06-13T11:37:56.335535+0000","last_fullsized":"2024-06-13T11:37:56.335535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:54:29.089099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336951+0000","last_change":"2024-06-13T11:37:56.336329+0000","last_active":"2024-06-13T11:37:56.336951+0000","last_peered":"2024-06-13T11:37:56.336951+0000","last_clean":"2024-06-13T11:37:56.336951+0000","last_became_active":"2024-06-13T11:37:56.335972+0000","last_became_peered":"2024-06-13T11:37:56.335972+0000","last_unstale":"2024-06-13T11:37:56.336951+0000","last_undegraded":"2024-06-13T11:37:56.336951+0000","last_fullsized":"2024-06-13T11:37:56.336951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306671+0000","last_change":"2024-06-13T11:37:55.312486+0000","last_active":"2024-06-13T11:37:56.306671+0000","last_peered":"2024-06-13T11:37:56.306671+0000","last_clean":"2024-06-13T11:37:56.306671+0000","last_became_active":"2024-06-13T11:37:55.312206+0000","last_became_peered":"2024-06-13T11:37:55.312206+0000","last_unstale":"2024-06-13T11:37:56.306671+0000","last_undegraded":"2024-06-13T11:37:56.306671+0000","last_fullsized":"2024-06-13T11:37:56.306671+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:14:01.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315037+0000","last_change":"2024-06-13T11:37:56.313649+0000","last_active":"2024-06-13T11:37:56.315037+0000","last_peered":"2024-06-13T11:37:56.315037+0000","last_clean":"2024-06-13T11:37:56.315037+0000","last_became_active":"2024-06-13T11:37:56.313376+0000","last_became_peered":"2024-06-13T11:37:56.313376+0000","last_unstale":"2024-06-13T11:37:56.315037+0000","last_undegraded":"2024-06-13T11:37:56.315037+0000","last_fullsized":"2024-06-13T11:37:56.315037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320310+0000","last_change":"2024-06-13T11:37:55.315779+0000","last_active":"2024-06-13T11:37:56.320310+0000","last_peered":"2024-06-13T11:37:56.320310+0000","last_clean":"2024-06-13T11:37:56.320310+0000","last_became_active":"2024-06-13T11:37:55.315487+0000","last_became_peered":"2024-06-13T11:37:55.315487+0000","last_unstale":"2024-06-13T11:37:56.320310+0000","last_undegraded":"2024-06-13T11:37:56.320310+0000","last_fullsized":"2024-06-13T11:37:56.320310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334552+0000","last_change":"2024-06-13T11:37:56.332594+0000","last_active":"2024-06-13T11:37:56.334552+0000","last_peered":"2024-06-13T11:37:56.334552+0000","last_clean":"2024-06-13T11:37:56.334552+0000","last_became_active":"2024-06-13T11:37:56.332265+0000","last_became_peered":"2024-06-13T11:37:56.332265+0000","last_unstale":"2024-06-13T11:37:56.334552+0000","last_undegraded":"2024-06-13T11:37:56.334552+0000","last_fullsized":"2024-06-13T11:37:56.334552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:04:56.197473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306156+0000","last_change":"2024-06-13T11:37:55.314354+0000","last_active":"2024-06-13T11:37:56.306156+0000","last_peered":"2024-06-13T11:37:56.306156+0000","last_clean":"2024-06-13T11:37:56.306156+0000","last_became_active":"2024-06-13T11:37:55.314034+0000","last_became_peered":"2024-06-13T11:37:55.314034+0000","last_unstale":"2024-06-13T11:37:56.306156+0000","last_undegraded":"2024-06-13T11:37:56.306156+0000","last_fullsized":"2024-06-13T11:37:56.306156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:29.902564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321709+0000","last_change":"2024-06-13T11:37:56.318282+0000","last_active":"2024-06-13T11:37:56.321709+0000","last_peered":"2024-06-13T11:37:56.321709+0000","last_clean":"2024-06-13T11:37:56.321709+0000","last_became_active":"2024-06-13T11:37:56.317985+0000","last_became_peered":"2024-06-13T11:37:56.317985+0000","last_unstale":"2024-06-13T11:37:56.321709+0000","last_undegraded":"2024-06-13T11:37:56.321709+0000","last_fullsized":"2024-06-13T11:37:56.321709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.323334+0000","last_change":"2024-06-13T11:37:55.313951+0000","last_active":"2024-06-13T11:37:56.323334+0000","last_peered":"2024-06-13T11:37:56.323334+0000","last_clean":"2024-06-13T11:37:56.323334+0000","last_became_active":"2024-06-13T11:37:55.313509+0000","last_became_peered":"2024-06-13T11:37:55.313509+0000","last_unstale":"2024-06-13T11:37:56.323334+0000","last_undegraded":"2024-06-13T11:37:56.323334+0000","last_fullsized":"2024-06-13T11:37:56.323334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:26.188457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336553+0000","last_change":"2024-06-13T11:37:56.333448+0000","last_active":"2024-06-13T11:37:56.336553+0000","last_peered":"2024-06-13T11:37:56.336553+0000","last_clean":"2024-06-13T11:37:56.336553+0000","last_became_active":"2024-06-13T11:37:56.332703+0000","last_became_peered":"2024-06-13T11:37:56.332703+0000","last_unstale":"2024-06-13T11:37:56.336553+0000","last_undegraded":"2024-06-13T11:37:56.336553+0000","last_fullsized":"2024-06-13T11:37:56.336553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306065+0000","last_change":"2024-06-13T11:37:55.310716+0000","last_active":"2024-06-13T11:37:56.306065+0000","last_peered":"2024-06-13T11:37:56.306065+0000","last_clean":"2024-06-13T11:37:56.306065+0000","last_became_active":"2024-06-13T11:37:55.310423+0000","last_became_peered":"2024-06-13T11:37:55.310423+0000","last_unstale":"2024-06-13T11:37:56.306065+0000","last_undegraded":"2024-06-13T11:37:56.306065+0000","last_fullsized":"2024-06-13T11:37:56.306065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:17:20.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324450+0000","last_change":"2024-06-13T11:37:56.323367+0000","last_active":"2024-06-13T11:37:56.324450+0000","last_peered":"2024-06-13T11:37:56.324450+0000","last_clean":"2024-06-13T11:37:56.324450+0000","last_became_active":"2024-06-13T11:37:56.323061+0000","last_became_peered":"2024-06-13T11:37:56.323061+0000","last_unstale":"2024-06-13T11:37:56.324450+0000","last_undegraded":"2024-06-13T11:37:56.324450+0000","last_fullsized":"2024-06-13T11:37:56.324450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:14:31.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315192+0000","last_change":"2024-06-13T11:37:55.316693+0000","last_active":"2024-06-13T11:37:56.315192+0000","last_peered":"2024-06-13T11:37:56.315192+0000","last_clean":"2024-06-13T11:37:56.315192+0000","last_became_active":"2024-06-13T11:37:55.316352+0000","last_became_peered":"2024-06-13T11:37:55.316352+0000","last_unstale":"2024-06-13T11:37:56.315192+0000","last_undegraded":"2024-06-13T11:37:56.315192+0000","last_fullsized":"2024-06-13T11:37:56.315192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332807+0000","last_change":"2024-06-13T11:37:56.330835+0000","last_active":"2024-06-13T11:37:56.332807+0000","last_peered":"2024-06-13T11:37:56.332807+0000","last_clean":"2024-06-13T11:37:56.332807+0000","last_became_active":"2024-06-13T11:37:56.330558+0000","last_became_peered":"2024-06-13T11:37:56.330558+0000","last_unstale":"2024-06-13T11:37:56.332807+0000","last_undegraded":"2024-06-13T11:37:56.332807+0000","last_fullsized":"2024-06-13T11:37:56.332807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314791+0000","last_change":"2024-06-13T11:37:55.317955+0000","last_active":"2024-06-13T11:37:56.314791+0000","last_peered":"2024-06-13T11:37:56.314791+0000","last_clean":"2024-06-13T11:37:56.314791+0000","last_became_active":"2024-06-13T11:37:55.317670+0000","last_became_peered":"2024-06-13T11:37:55.317670+0000","last_unstale":"2024-06-13T11:37:56.314791+0000","last_undegraded":"2024-06-13T11:37:56.314791+0000","last_fullsized":"2024-06-13T11:37:56.314791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:49.054318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328843+0000","last_change":"2024-06-13T11:37:56.327970+0000","last_active":"2024-06-13T11:37:56.328843+0000","last_peered":"2024-06-13T11:37:56.328843+0000","last_clean":"2024-06-13T11:37:56.328843+0000","last_became_active":"2024-06-13T11:37:56.327680+0000","last_became_peered":"2024-06-13T11:37:56.327680+0000","last_unstale":"2024-06-13T11:37:56.328843+0000","last_undegraded":"2024-06-13T11:37:56.328843+0000","last_fullsized":"2024-06-13T11:37:56.328843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.299492+0000","last_change":"2024-06-13T11:37:54.299492+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.299492+0000","last_undegraded":"2024-06-13T11:37:54.299492+0000","last_fullsized":"2024-06-13T11:37:54.299492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328974+0000","last_change":"2024-06-13T11:37:56.325514+0000","last_active":"2024-06-13T11:37:56.328974+0000","last_peered":"2024-06-13T11:37:56.328974+0000","last_clean":"2024-06-13T11:37:56.328974+0000","last_became_active":"2024-06-13T11:37:56.324920+0000","last_became_peered":"2024-06-13T11:37:56.324920+0000","last_unstale":"2024-06-13T11:37:56.328974+0000","last_undegraded":"2024-06-13T11:37:56.328974+0000","last_fullsized":"2024-06-13T11:37:56.328974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:22.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315670+0000","last_change":"2024-06-13T11:37:55.308637+0000","last_active":"2024-06-13T11:37:56.315670+0000","last_peered":"2024-06-13T11:37:56.315670+0000","last_clean":"2024-06-13T11:37:56.315670+0000","last_became_active":"2024-06-13T11:37:55.308361+0000","last_became_peered":"2024-06-13T11:37:55.308361+0000","last_unstale":"2024-06-13T11:37:56.315670+0000","last_undegraded":"2024-06-13T11:37:56.315670+0000","last_fullsized":"2024-06-13T11:37:56.315670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336100+0000","last_change":"2024-06-13T11:37:56.332842+0000","last_active":"2024-06-13T11:37:56.336100+0000","last_peered":"2024-06-13T11:37:56.336100+0000","last_clean":"2024-06-13T11:37:56.336100+0000","last_became_active":"2024-06-13T11:37:56.332557+0000","last_became_peered":"2024-06-13T11:37:56.332557+0000","last_unstale":"2024-06-13T11:37:56.336100+0000","last_undegraded":"2024-06-13T11:37:56.336100+0000","last_fullsized":"2024-06-13T11:37:56.336100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.310725+0000","last_change":"2024-06-13T11:37:55.315564+0000","last_active":"2024-06-13T11:37:56.310725+0000","last_peered":"2024-06-13T11:37:56.310725+0000","last_clean":"2024-06-13T11:37:56.310725+0000","last_became_active":"2024-06-13T11:37:55.313545+0000","last_became_peered":"2024-06-13T11:37:55.313545+0000","last_unstale":"2024-06-13T11:37:56.310725+0000","last_undegraded":"2024-06-13T11:37:56.310725+0000","last_fullsized":"2024-06-13T11:37:56.310725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:46.960127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322853+0000","last_change":"2024-06-13T11:37:56.319494+0000","last_active":"2024-06-13T11:37:56.322853+0000","last_peered":"2024-06-13T11:37:56.322853+0000","last_clean":"2024-06-13T11:37:56.322853+0000","last_became_active":"2024-06-13T11:37:56.319182+0000","last_became_peered":"2024-06-13T11:37:56.319182+0000","last_unstale":"2024-06-13T11:37:56.322853+0000","last_undegraded":"2024-06-13T11:37:56.322853+0000","last_fullsized":"2024-06-13T11:37:56.322853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320500+0000","last_change":"2024-06-13T11:37:55.318759+0000","last_active":"2024-06-13T11:37:56.320500+0000","last_peered":"2024-06-13T11:37:56.320500+0000","last_clean":"2024-06-13T11:37:56.320500+0000","last_became_active":"2024-06-13T11:37:55.318420+0000","last_became_peered":"2024-06-13T11:37:55.318420+0000","last_unstale":"2024-06-13T11:37:56.320500+0000","last_undegraded":"2024-06-13T11:37:56.320500+0000","last_fullsized":"2024-06-13T11:37:56.320500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:21.172360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319200+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:56.319200+0000","last_peered":"2024-06-13T11:37:56.319200+0000","last_clean":"2024-06-13T11:37:56.319200+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:56.319200+0000","last_undegraded":"2024-06-13T11:37:56.319200+0000","last_fullsized":"2024-06-13T11:37:56.319200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":172124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":152011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:38:00.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:38:00.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 Processor -- start 2024-06-13T11:38:00.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 -- start start 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f85e81412d0 0x7f85e806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85e806f090 0x7f85e8161f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e81416b0 con 0x7f85e8162470 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f85e80b1af0 con 0x7f85e81412d0 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.838+0000 7f85ecaf5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f85e8162cd0 con 0x7f85e806f090 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f85e81412d0 0x7f85e806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f85e81412d0 0x7f85e806eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55036/0 (socket says 172.21.15.43:55036) 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 -- 172.21.15.43:0/912064049 learned_addr learned my addr 172.21.15.43:0/912064049 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85dffff640 1 --2- 172.21.15.43:0/912064049 >> v2:172.21.15.53:3300/0 conn(0x7f85e806f090 0x7f85e8161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 -- 172.21.15.43:0/912064049 >> v2:172.21.15.53:3300/0 conn(0x7f85e806f090 msgr2=0x7f85e8161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 --2- 172.21.15.43:0/912064049 >> v2:172.21.15.53:3300/0 conn(0x7f85e806f090 0x7f85e8161f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 -- 172.21.15.43:0/912064049 >> v1:172.21.15.53:6789/0 conn(0x7f85e8162470 legacy=0x7f85e8070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85e659c640 1 -- 172.21.15.43:0/912064049 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e815ebe0 con 0x7f85e81412d0 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.839+0000 7f85dffff640 1 --2- 172.21.15.43:0/912064049 >> v2:172.21.15.53:3300/0 conn(0x7f85e806f090 0x7f85e8161f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85e659c640 1 --2- 172.21.15.43:0/912064049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e81412d0 0x7f85e806eb50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f85e80b3a40 tx=0x7f85d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d860d69c19d34b88 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85e5d9b640 1 -- 172.21.15.43:0/912064049 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8037070 con 0x7f85e81412d0 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85e5d9b640 1 -- 172.21.15.43:0/912064049 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d8032440 con 0x7f85e81412d0 2024-06-13T11:38:00.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85e5d9b640 1 -- 172.21.15.43:0/912064049 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8032810 con 0x7f85e81412d0 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 -- 172.21.15.43:0/912064049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e81412d0 msgr2=0x7f85e806eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/912064049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e81412d0 0x7f85e806eb50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f85e80b3a40 tx=0x7f85d802a230 comp rx=0 tx=0).stop 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 -- 172.21.15.43:0/912064049 shutdown_connections 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/912064049 >> v2:172.21.15.53:3300/0 conn(0x7f85e806f090 0x7f85e8161f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/912064049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e81412d0 0x7f85e806eb50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 -- 172.21.15.43:0/912064049 >> 172.21.15.43:0/912064049 conn(0x7f85e806e030 msgr2=0x7f85e806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.840+0000 7f85ecaf5640 1 -- 172.21.15.43:0/912064049 shutdown_connections 2024-06-13T11:38:00.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.841+0000 7f85ecaf5640 1 -- 172.21.15.43:0/912064049 wait complete. 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.842+0000 7f85ecaf5640 1 Processor -- start 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.842+0000 7f85ecaf5640 1 -- start start 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85ecaf5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85e806f090 0x7f85e8157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85ecaf5640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85e81412d0 0x7f85e8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85ecaf5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 0x7f85e81569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85ecaf5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f85e815e890 con 0x7f85e8162470 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85ecaf5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f85e815f1a0 con 0x7f85e806f090 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85ecaf5640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f85e815f6c0 con 0x7f85e81412d0 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 0x7f85e81569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 0x7f85e81569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55046/0 (socket says 172.21.15.43:55046) 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 -- 172.21.15.43:0/1142641520 learned_addr learned my addr 172.21.15.43:0/1142641520 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e659c640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85e806f090 0x7f85e8157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85dffff640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85e81412d0 0x7f85e8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 -- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85e81412d0 msgr2=0x7f85e8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85e81412d0 0x7f85e8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 -- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85e806f090 msgr2=0x7f85e8157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85e806f090 0x7f85e8157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 -- 172.21.15.43:0/1142641520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e8157930 con 0x7f85e8162470 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85e6d9d640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 0x7f85e81569b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b970 tx=0x7f85e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.843+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0019070 con 0x7f85e8162470 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.844+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e000cb40 con 0x7f85e8162470 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.844+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e8157c10 con 0x7f85e8162470 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.844+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0014440 con 0x7f85e8162470 2024-06-13T11:38:00.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.844+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e81581d0 con 0x7f85e8162470 2024-06-13T11:38:00.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.845+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e804ffb0 con 0x7f85e8162470 2024-06-13T11:38:00.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.845+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85e001c070 con 0x7f85e8162470 2024-06-13T11:38:00.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.846+0000 7f85deffd640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f85c806be30 0x7f85c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:00.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.846+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f85e008ac60 con 0x7f85e8162470 2024-06-13T11:38:00.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.846+0000 7f85e659c640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f85c806be30 0x7f85c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:00.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.846+0000 7f85e659c640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f85c806be30 0x7f85c806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85d8034000 tx=0x7f85d802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:00.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:00.850+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f85e0059480 con 0x7f85e8162470 2024-06-13T11:38:01.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.031+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85e8158d10 con 0x7f85c806be30 2024-06-13T11:38:01.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.038+0000 7f85deffd640 1 -- 172.21.15.43:0/1142641520 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250712 (secure 0 0 0) 0x7f85d807f370 con 0x7f85c806be30 2024-06-13T11:38:01.039 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:01.041 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f85c806be30 msgr2=0x7f85c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f85c806be30 0x7f85c806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85d8034000 tx=0x7f85d802e000 comp rx=0 tx=0).stop 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 msgr2=0x7f85e81569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 0x7f85e81569b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b970 tx=0x7f85e000be30 comp rx=0 tx=0).stop 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 shutdown_connections 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f85c806be30 0x7f85c806e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85e8162470 0x7f85e81569b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f85e81412d0 0x7f85e8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 --2- 172.21.15.43:0/1142641520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85e806f090 0x7f85e8157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.041+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 >> 172.21.15.43:0/1142641520 conn(0x7f85e806e030 msgr2=0x7f85e806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:01.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.042+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 shutdown_connections 2024-06-13T11:38:01.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.042+0000 7f85ecaf5640 1 -- 172.21.15.43:0/1142641520 wait complete. 2024-06-13T11:38:01.052 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-06-13T11:37:59.361045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253720,"kb_used_data":4256,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721000,"statfs":{"total":773094113280,"available":772834304000,"internally_reserved":0,"allocated":4358144,"data_stored":2494193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.067473"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324984+0000","last_change":"2024-06-13T11:37:56.323330+0000","last_active":"2024-06-13T11:37:56.324984+0000","last_peered":"2024-06-13T11:37:56.324984+0000","last_clean":"2024-06-13T11:37:56.324984+0000","last_became_active":"2024-06-13T11:37:56.323036+0000","last_became_peered":"2024-06-13T11:37:56.323036+0000","last_unstale":"2024-06-13T11:37:56.324984+0000","last_undegraded":"2024-06-13T11:37:56.324984+0000","last_fullsized":"2024-06-13T11:37:56.324984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:21:41.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.318958+0000","last_change":"2024-06-13T11:37:56.317705+0000","last_active":"2024-06-13T11:37:56.318958+0000","last_peered":"2024-06-13T11:37:56.318958+0000","last_clean":"2024-06-13T11:37:56.318958+0000","last_became_active":"2024-06-13T11:37:56.317411+0000","last_became_peered":"2024-06-13T11:37:56.317411+0000","last_unstale":"2024-06-13T11:37:56.318958+0000","last_undegraded":"2024-06-13T11:37:56.318958+0000","last_fullsized":"2024-06-13T11:37:56.318958+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332928+0000","last_change":"2024-06-13T11:37:56.331226+0000","last_active":"2024-06-13T11:37:56.332928+0000","last_peered":"2024-06-13T11:37:56.332928+0000","last_clean":"2024-06-13T11:37:56.332928+0000","last_became_active":"2024-06-13T11:37:56.330954+0000","last_became_peered":"2024-06-13T11:37:56.330954+0000","last_unstale":"2024-06-13T11:37:56.332928+0000","last_undegraded":"2024-06-13T11:37:56.332928+0000","last_fullsized":"2024-06-13T11:37:56.332928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333203+0000","last_change":"2024-06-13T11:37:56.328375+0000","last_active":"2024-06-13T11:37:56.333203+0000","last_peered":"2024-06-13T11:37:56.333203+0000","last_clean":"2024-06-13T11:37:56.333203+0000","last_became_active":"2024-06-13T11:37:56.327777+0000","last_became_peered":"2024-06-13T11:37:56.327777+0000","last_unstale":"2024-06-13T11:37:56.333203+0000","last_undegraded":"2024-06-13T11:37:56.333203+0000","last_fullsized":"2024-06-13T11:37:56.333203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:44.669303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333007+0000","last_change":"2024-06-13T11:37:56.330392+0000","last_active":"2024-06-13T11:37:56.333007+0000","last_peered":"2024-06-13T11:37:56.333007+0000","last_clean":"2024-06-13T11:37:56.333007+0000","last_became_active":"2024-06-13T11:37:56.330114+0000","last_became_peered":"2024-06-13T11:37:56.330114+0000","last_unstale":"2024-06-13T11:37:56.333007+0000","last_undegraded":"2024-06-13T11:37:56.333007+0000","last_fullsized":"2024-06-13T11:37:56.333007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:42.005975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320115+0000","last_change":"2024-06-13T11:37:56.316382+0000","last_active":"2024-06-13T11:37:56.320115+0000","last_peered":"2024-06-13T11:37:56.320115+0000","last_clean":"2024-06-13T11:37:56.320115+0000","last_became_active":"2024-06-13T11:37:56.316079+0000","last_became_peered":"2024-06-13T11:37:56.316079+0000","last_unstale":"2024-06-13T11:37:56.320115+0000","last_undegraded":"2024-06-13T11:37:56.320115+0000","last_fullsized":"2024-06-13T11:37:56.320115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322531+0000","last_change":"2024-06-13T11:37:56.320153+0000","last_active":"2024-06-13T11:37:56.322531+0000","last_peered":"2024-06-13T11:37:56.322531+0000","last_clean":"2024-06-13T11:37:56.322531+0000","last_became_active":"2024-06-13T11:37:56.319164+0000","last_became_peered":"2024-06-13T11:37:56.319164+0000","last_unstale":"2024-06-13T11:37:56.322531+0000","last_undegraded":"2024-06-13T11:37:56.322531+0000","last_fullsized":"2024-06-13T11:37:56.322531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333612+0000","last_change":"2024-06-13T11:37:56.329963+0000","last_active":"2024-06-13T11:37:56.333612+0000","last_peered":"2024-06-13T11:37:56.333612+0000","last_clean":"2024-06-13T11:37:56.333612+0000","last_became_active":"2024-06-13T11:37:56.329661+0000","last_became_peered":"2024-06-13T11:37:56.329661+0000","last_unstale":"2024-06-13T11:37:56.333612+0000","last_undegraded":"2024-06-13T11:37:56.333612+0000","last_fullsized":"2024-06-13T11:37:56.333612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:33:06.820994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326642+0000","last_change":"2024-06-13T11:37:56.323714+0000","last_active":"2024-06-13T11:37:56.326642+0000","last_peered":"2024-06-13T11:37:56.326642+0000","last_clean":"2024-06-13T11:37:56.326642+0000","last_became_active":"2024-06-13T11:37:56.323416+0000","last_became_peered":"2024-06-13T11:37:56.323416+0000","last_unstale":"2024-06-13T11:37:56.326642+0000","last_undegraded":"2024-06-13T11:37:56.326642+0000","last_fullsized":"2024-06-13T11:37:56.326642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:20.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.330128+0000","last_change":"2024-06-13T11:37:56.326263+0000","last_active":"2024-06-13T11:37:56.330128+0000","last_peered":"2024-06-13T11:37:56.330128+0000","last_clean":"2024-06-13T11:37:56.330128+0000","last_became_active":"2024-06-13T11:37:56.325928+0000","last_became_peered":"2024-06-13T11:37:56.325928+0000","last_unstale":"2024-06-13T11:37:56.330128+0000","last_undegraded":"2024-06-13T11:37:56.330128+0000","last_fullsized":"2024-06-13T11:37:56.330128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:28.052669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335071+0000","last_change":"2024-06-13T11:37:56.328875+0000","last_active":"2024-06-13T11:37:56.335071+0000","last_peered":"2024-06-13T11:37:56.335071+0000","last_clean":"2024-06-13T11:37:56.335071+0000","last_became_active":"2024-06-13T11:37:56.328466+0000","last_became_peered":"2024-06-13T11:37:56.328466+0000","last_unstale":"2024-06-13T11:37:56.335071+0000","last_undegraded":"2024-06-13T11:37:56.335071+0000","last_fullsized":"2024-06-13T11:37:56.335071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:32:34.940913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332760+0000","last_change":"2024-06-13T11:37:56.329293+0000","last_active":"2024-06-13T11:37:56.332760+0000","last_peered":"2024-06-13T11:37:56.332760+0000","last_clean":"2024-06-13T11:37:56.332760+0000","last_became_active":"2024-06-13T11:37:56.329023+0000","last_became_peered":"2024-06-13T11:37:56.329023+0000","last_unstale":"2024-06-13T11:37:56.332760+0000","last_undegraded":"2024-06-13T11:37:56.332760+0000","last_fullsized":"2024-06-13T11:37:56.332760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331363+0000","last_change":"2024-06-13T11:37:56.327065+0000","last_active":"2024-06-13T11:37:56.331363+0000","last_peered":"2024-06-13T11:37:56.331363+0000","last_clean":"2024-06-13T11:37:56.331363+0000","last_became_active":"2024-06-13T11:37:56.326677+0000","last_became_peered":"2024-06-13T11:37:56.326677+0000","last_unstale":"2024-06-13T11:37:56.331363+0000","last_undegraded":"2024-06-13T11:37:56.331363+0000","last_fullsized":"2024-06-13T11:37:56.331363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:53.607284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336028+0000","last_change":"2024-06-13T11:37:56.333377+0000","last_active":"2024-06-13T11:37:56.336028+0000","last_peered":"2024-06-13T11:37:56.336028+0000","last_clean":"2024-06-13T11:37:56.336028+0000","last_became_active":"2024-06-13T11:37:56.333061+0000","last_became_peered":"2024-06-13T11:37:56.333061+0000","last_unstale":"2024-06-13T11:37:56.336028+0000","last_undegraded":"2024-06-13T11:37:56.336028+0000","last_fullsized":"2024-06-13T11:37:56.336028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322572+0000","last_change":"2024-06-13T11:37:56.320422+0000","last_active":"2024-06-13T11:37:56.322572+0000","last_peered":"2024-06-13T11:37:56.322572+0000","last_clean":"2024-06-13T11:37:56.322572+0000","last_became_active":"2024-06-13T11:37:56.319882+0000","last_became_peered":"2024-06-13T11:37:56.319882+0000","last_unstale":"2024-06-13T11:37:56.322572+0000","last_undegraded":"2024-06-13T11:37:56.322572+0000","last_fullsized":"2024-06-13T11:37:56.322572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:57:21.388732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338304+0000","last_change":"2024-06-13T11:37:56.337108+0000","last_active":"2024-06-13T11:37:56.338304+0000","last_peered":"2024-06-13T11:37:56.338304+0000","last_clean":"2024-06-13T11:37:56.338304+0000","last_became_active":"2024-06-13T11:37:56.336726+0000","last_became_peered":"2024-06-13T11:37:56.336726+0000","last_unstale":"2024-06-13T11:37:56.338304+0000","last_undegraded":"2024-06-13T11:37:56.338304+0000","last_fullsized":"2024-06-13T11:37:56.338304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338335+0000","last_change":"2024-06-13T11:37:56.336965+0000","last_active":"2024-06-13T11:37:56.338335+0000","last_peered":"2024-06-13T11:37:56.338335+0000","last_clean":"2024-06-13T11:37:56.338335+0000","last_became_active":"2024-06-13T11:37:56.336655+0000","last_became_peered":"2024-06-13T11:37:56.336655+0000","last_unstale":"2024-06-13T11:37:56.338335+0000","last_undegraded":"2024-06-13T11:37:56.338335+0000","last_fullsized":"2024-06-13T11:37:56.338335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322566+0000","last_change":"2024-06-13T11:37:56.317302+0000","last_active":"2024-06-13T11:37:56.322566+0000","last_peered":"2024-06-13T11:37:56.322566+0000","last_clean":"2024-06-13T11:37:56.322566+0000","last_became_active":"2024-06-13T11:37:56.316660+0000","last_became_peered":"2024-06-13T11:37:56.316660+0000","last_unstale":"2024-06-13T11:37:56.322566+0000","last_undegraded":"2024-06-13T11:37:56.322566+0000","last_fullsized":"2024-06-13T11:37:56.322566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:41:42.438398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322585+0000","last_change":"2024-06-13T11:37:56.320203+0000","last_active":"2024-06-13T11:37:56.322585+0000","last_peered":"2024-06-13T11:37:56.322585+0000","last_clean":"2024-06-13T11:37:56.322585+0000","last_became_active":"2024-06-13T11:37:56.319914+0000","last_became_peered":"2024-06-13T11:37:56.319914+0000","last_unstale":"2024-06-13T11:37:56.322585+0000","last_undegraded":"2024-06-13T11:37:56.322585+0000","last_fullsized":"2024-06-13T11:37:56.322585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:34.553237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331239+0000","last_change":"2024-06-13T11:37:56.328768+0000","last_active":"2024-06-13T11:37:56.331239+0000","last_peered":"2024-06-13T11:37:56.331239+0000","last_clean":"2024-06-13T11:37:56.331239+0000","last_became_active":"2024-06-13T11:37:56.328430+0000","last_became_peered":"2024-06-13T11:37:56.328430+0000","last_unstale":"2024-06-13T11:37:56.331239+0000","last_undegraded":"2024-06-13T11:37:56.331239+0000","last_fullsized":"2024-06-13T11:37:56.331239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336588+0000","last_change":"2024-06-13T11:37:56.333430+0000","last_active":"2024-06-13T11:37:56.336588+0000","last_peered":"2024-06-13T11:37:56.336588+0000","last_clean":"2024-06-13T11:37:56.336588+0000","last_became_active":"2024-06-13T11:37:56.333164+0000","last_became_peered":"2024-06-13T11:37:56.333164+0000","last_unstale":"2024-06-13T11:37:56.336588+0000","last_undegraded":"2024-06-13T11:37:56.336588+0000","last_fullsized":"2024-06-13T11:37:56.336588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328011+0000","last_change":"2024-06-13T11:37:56.326591+0000","last_active":"2024-06-13T11:37:56.328011+0000","last_peered":"2024-06-13T11:37:56.328011+0000","last_clean":"2024-06-13T11:37:56.328011+0000","last_became_active":"2024-06-13T11:37:56.326263+0000","last_became_peered":"2024-06-13T11:37:56.326263+0000","last_unstale":"2024-06-13T11:37:56.328011+0000","last_undegraded":"2024-06-13T11:37:56.328011+0000","last_fullsized":"2024-06-13T11:37:56.328011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:04:39.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.327272+0000","last_change":"2024-06-13T11:37:56.325540+0000","last_active":"2024-06-13T11:37:56.327272+0000","last_peered":"2024-06-13T11:37:56.327272+0000","last_clean":"2024-06-13T11:37:56.327272+0000","last_became_active":"2024-06-13T11:37:56.325219+0000","last_became_peered":"2024-06-13T11:37:56.325219+0000","last_unstale":"2024-06-13T11:37:56.327272+0000","last_undegraded":"2024-06-13T11:37:56.327272+0000","last_fullsized":"2024-06-13T11:37:56.327272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328276+0000","last_change":"2024-06-13T11:37:56.323559+0000","last_active":"2024-06-13T11:37:56.328276+0000","last_peered":"2024-06-13T11:37:56.328276+0000","last_clean":"2024-06-13T11:37:56.328276+0000","last_became_active":"2024-06-13T11:37:56.323291+0000","last_became_peered":"2024-06-13T11:37:56.323291+0000","last_unstale":"2024-06-13T11:37:56.328276+0000","last_undegraded":"2024-06-13T11:37:56.328276+0000","last_fullsized":"2024-06-13T11:37:56.328276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:38:46.544540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-13T11:37:55.292803+0000","last_change":"2024-06-13T11:37:55.292803+0000","last_active":"2024-06-13T11:37:55.292803+0000","last_peered":"2024-06-13T11:37:55.292803+0000","last_clean":"2024-06-13T11:37:55.292803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:55.292803+0000","last_undegraded":"2024-06-13T11:37:55.292803+0000","last_fullsized":"2024-06-13T11:37:55.292803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336610+0000","last_change":"2024-06-13T11:37:56.334243+0000","last_active":"2024-06-13T11:37:56.336610+0000","last_peered":"2024-06-13T11:37:56.336610+0000","last_clean":"2024-06-13T11:37:56.336610+0000","last_became_active":"2024-06-13T11:37:56.333952+0000","last_became_peered":"2024-06-13T11:37:56.333952+0000","last_unstale":"2024-06-13T11:37:56.336610+0000","last_undegraded":"2024-06-13T11:37:56.336610+0000","last_fullsized":"2024-06-13T11:37:56.336610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321475+0000","last_change":"2024-06-13T11:37:56.318049+0000","last_active":"2024-06-13T11:37:56.321475+0000","last_peered":"2024-06-13T11:37:56.321475+0000","last_clean":"2024-06-13T11:37:56.321475+0000","last_became_active":"2024-06-13T11:37:56.317769+0000","last_became_peered":"2024-06-13T11:37:56.317769+0000","last_unstale":"2024-06-13T11:37:56.321475+0000","last_undegraded":"2024-06-13T11:37:56.321475+0000","last_fullsized":"2024-06-13T11:37:56.321475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338431+0000","last_change":"2024-06-13T11:37:56.336846+0000","last_active":"2024-06-13T11:37:56.338431+0000","last_peered":"2024-06-13T11:37:56.338431+0000","last_clean":"2024-06-13T11:37:56.338431+0000","last_became_active":"2024-06-13T11:37:56.336555+0000","last_became_peered":"2024-06-13T11:37:56.336555+0000","last_unstale":"2024-06-13T11:37:56.338431+0000","last_undegraded":"2024-06-13T11:37:56.338431+0000","last_fullsized":"2024-06-13T11:37:56.338431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.300009+0000","last_change":"2024-06-13T11:37:54.300009+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.300009+0000","last_undegraded":"2024-06-13T11:37:54.300009+0000","last_fullsized":"2024-06-13T11:37:54.300009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332783+0000","last_change":"2024-06-13T11:37:56.330952+0000","last_active":"2024-06-13T11:37:56.332783+0000","last_peered":"2024-06-13T11:37:56.332783+0000","last_clean":"2024-06-13T11:37:56.332783+0000","last_became_active":"2024-06-13T11:37:56.330604+0000","last_became_peered":"2024-06-13T11:37:56.330604+0000","last_unstale":"2024-06-13T11:37:56.332783+0000","last_undegraded":"2024-06-13T11:37:56.332783+0000","last_fullsized":"2024-06-13T11:37:56.332783+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337848+0000","last_change":"2024-06-13T11:37:55.319411+0000","last_active":"2024-06-13T11:37:56.337848+0000","last_peered":"2024-06-13T11:37:56.337848+0000","last_clean":"2024-06-13T11:37:56.337848+0000","last_became_active":"2024-06-13T11:37:55.318305+0000","last_became_peered":"2024-06-13T11:37:55.318305+0000","last_unstale":"2024-06-13T11:37:56.337848+0000","last_undegraded":"2024-06-13T11:37:56.337848+0000","last_fullsized":"2024-06-13T11:37:56.337848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:15:12.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337375+0000","last_change":"2024-06-13T11:37:56.334255+0000","last_active":"2024-06-13T11:37:56.337375+0000","last_peered":"2024-06-13T11:37:56.337375+0000","last_clean":"2024-06-13T11:37:56.337375+0000","last_became_active":"2024-06-13T11:37:56.333761+0000","last_became_peered":"2024-06-13T11:37:56.333761+0000","last_unstale":"2024-06-13T11:37:56.337375+0000","last_undegraded":"2024-06-13T11:37:56.337375+0000","last_fullsized":"2024-06-13T11:37:56.337375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324180+0000","last_change":"2024-06-13T11:37:55.318481+0000","last_active":"2024-06-13T11:37:56.324180+0000","last_peered":"2024-06-13T11:37:56.324180+0000","last_clean":"2024-06-13T11:37:56.324180+0000","last_became_active":"2024-06-13T11:37:55.318164+0000","last_became_peered":"2024-06-13T11:37:55.318164+0000","last_unstale":"2024-06-13T11:37:56.324180+0000","last_undegraded":"2024-06-13T11:37:56.324180+0000","last_fullsized":"2024-06-13T11:37:56.324180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:33.823945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319390+0000","last_change":"2024-06-13T11:37:56.318534+0000","last_active":"2024-06-13T11:37:56.319390+0000","last_peered":"2024-06-13T11:37:56.319390+0000","last_clean":"2024-06-13T11:37:56.319390+0000","last_became_active":"2024-06-13T11:37:56.318248+0000","last_became_peered":"2024-06-13T11:37:56.318248+0000","last_unstale":"2024-06-13T11:37:56.319390+0000","last_undegraded":"2024-06-13T11:37:56.319390+0000","last_fullsized":"2024-06-13T11:37:56.319390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:24.453927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335250+0000","last_change":"2024-06-13T11:37:55.308705+0000","last_active":"2024-06-13T11:37:56.335250+0000","last_peered":"2024-06-13T11:37:56.335250+0000","last_clean":"2024-06-13T11:37:56.335250+0000","last_became_active":"2024-06-13T11:37:55.308399+0000","last_became_peered":"2024-06-13T11:37:55.308399+0000","last_unstale":"2024-06-13T11:37:56.335250+0000","last_undegraded":"2024-06-13T11:37:56.335250+0000","last_fullsized":"2024-06-13T11:37:56.335250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326916+0000","last_change":"2024-06-13T11:37:56.325979+0000","last_active":"2024-06-13T11:37:56.326916+0000","last_peered":"2024-06-13T11:37:56.326916+0000","last_clean":"2024-06-13T11:37:56.326916+0000","last_became_active":"2024-06-13T11:37:56.325682+0000","last_became_peered":"2024-06-13T11:37:56.325682+0000","last_unstale":"2024-06-13T11:37:56.326916+0000","last_undegraded":"2024-06-13T11:37:56.326916+0000","last_fullsized":"2024-06-13T11:37:56.326916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:34.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326923+0000","last_change":"2024-06-13T11:37:55.314283+0000","last_active":"2024-06-13T11:37:56.326923+0000","last_peered":"2024-06-13T11:37:56.326923+0000","last_clean":"2024-06-13T11:37:56.326923+0000","last_became_active":"2024-06-13T11:37:55.313981+0000","last_became_peered":"2024-06-13T11:37:55.313981+0000","last_unstale":"2024-06-13T11:37:56.326923+0000","last_undegraded":"2024-06-13T11:37:56.326923+0000","last_fullsized":"2024-06-13T11:37:56.326923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:32.867795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322553+0000","last_change":"2024-06-13T11:37:56.320173+0000","last_active":"2024-06-13T11:37:56.322553+0000","last_peered":"2024-06-13T11:37:56.322553+0000","last_clean":"2024-06-13T11:37:56.322553+0000","last_became_active":"2024-06-13T11:37:56.319550+0000","last_became_peered":"2024-06-13T11:37:56.319550+0000","last_unstale":"2024-06-13T11:37:56.322553+0000","last_undegraded":"2024-06-13T11:37:56.322553+0000","last_fullsized":"2024-06-13T11:37:56.322553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337594+0000","last_change":"2024-06-13T11:37:55.319302+0000","last_active":"2024-06-13T11:37:56.337594+0000","last_peered":"2024-06-13T11:37:56.337594+0000","last_clean":"2024-06-13T11:37:56.337594+0000","last_became_active":"2024-06-13T11:37:55.318884+0000","last_became_peered":"2024-06-13T11:37:55.318884+0000","last_unstale":"2024-06-13T11:37:56.337594+0000","last_undegraded":"2024-06-13T11:37:56.337594+0000","last_fullsized":"2024-06-13T11:37:56.337594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328993+0000","last_change":"2024-06-13T11:37:56.325772+0000","last_active":"2024-06-13T11:37:56.328993+0000","last_peered":"2024-06-13T11:37:56.328993+0000","last_clean":"2024-06-13T11:37:56.328993+0000","last_became_active":"2024-06-13T11:37:56.325245+0000","last_became_peered":"2024-06-13T11:37:56.325245+0000","last_unstale":"2024-06-13T11:37:56.328993+0000","last_undegraded":"2024-06-13T11:37:56.328993+0000","last_fullsized":"2024-06-13T11:37:56.328993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313464+0000","last_change":"2024-06-13T11:37:55.312037+0000","last_active":"2024-06-13T11:37:56.313464+0000","last_peered":"2024-06-13T11:37:56.313464+0000","last_clean":"2024-06-13T11:37:56.313464+0000","last_became_active":"2024-06-13T11:37:55.311676+0000","last_became_peered":"2024-06-13T11:37:55.311676+0000","last_unstale":"2024-06-13T11:37:56.313464+0000","last_undegraded":"2024-06-13T11:37:56.313464+0000","last_fullsized":"2024-06-13T11:37:56.313464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333571+0000","last_change":"2024-06-13T11:37:56.331802+0000","last_active":"2024-06-13T11:37:56.333571+0000","last_peered":"2024-06-13T11:37:56.333571+0000","last_clean":"2024-06-13T11:37:56.333571+0000","last_became_active":"2024-06-13T11:37:56.331443+0000","last_became_peered":"2024-06-13T11:37:56.331443+0000","last_unstale":"2024-06-13T11:37:56.333571+0000","last_undegraded":"2024-06-13T11:37:56.333571+0000","last_fullsized":"2024-06-13T11:37:56.333571+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:22.710612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314234+0000","last_change":"2024-06-13T11:37:55.309937+0000","last_active":"2024-06-13T11:37:56.314234+0000","last_peered":"2024-06-13T11:37:56.314234+0000","last_clean":"2024-06-13T11:37:56.314234+0000","last_became_active":"2024-06-13T11:37:55.309677+0000","last_became_peered":"2024-06-13T11:37:55.309677+0000","last_unstale":"2024-06-13T11:37:56.314234+0000","last_undegraded":"2024-06-13T11:37:56.314234+0000","last_fullsized":"2024-06-13T11:37:56.314234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:06:17.518923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333134+0000","last_change":"2024-06-13T11:37:56.328114+0000","last_active":"2024-06-13T11:37:56.333134+0000","last_peered":"2024-06-13T11:37:56.333134+0000","last_clean":"2024-06-13T11:37:56.333134+0000","last_became_active":"2024-06-13T11:37:56.327404+0000","last_became_peered":"2024-06-13T11:37:56.327404+0000","last_unstale":"2024-06-13T11:37:56.333134+0000","last_undegraded":"2024-06-13T11:37:56.333134+0000","last_fullsized":"2024-06-13T11:37:56.333134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:47.251555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.311070+0000","last_change":"2024-06-13T11:37:55.317546+0000","last_active":"2024-06-13T11:37:56.311070+0000","last_peered":"2024-06-13T11:37:56.311070+0000","last_clean":"2024-06-13T11:37:56.311070+0000","last_became_active":"2024-06-13T11:37:55.317278+0000","last_became_peered":"2024-06-13T11:37:55.317278+0000","last_unstale":"2024-06-13T11:37:56.311070+0000","last_undegraded":"2024-06-13T11:37:56.311070+0000","last_fullsized":"2024-06-13T11:37:56.311070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:57.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336574+0000","last_change":"2024-06-13T11:37:56.333326+0000","last_active":"2024-06-13T11:37:56.336574+0000","last_peered":"2024-06-13T11:37:56.336574+0000","last_clean":"2024-06-13T11:37:56.336574+0000","last_became_active":"2024-06-13T11:37:56.332950+0000","last_became_peered":"2024-06-13T11:37:56.332950+0000","last_unstale":"2024-06-13T11:37:56.336574+0000","last_undegraded":"2024-06-13T11:37:56.336574+0000","last_fullsized":"2024-06-13T11:37:56.336574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.309602+0000","last_change":"2024-06-13T11:37:55.313056+0000","last_active":"2024-06-13T11:37:56.309602+0000","last_peered":"2024-06-13T11:37:56.309602+0000","last_clean":"2024-06-13T11:37:56.309602+0000","last_became_active":"2024-06-13T11:37:55.312782+0000","last_became_peered":"2024-06-13T11:37:55.312782+0000","last_unstale":"2024-06-13T11:37:56.309602+0000","last_undegraded":"2024-06-13T11:37:56.309602+0000","last_fullsized":"2024-06-13T11:37:56.309602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:06.789673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336735+0000","last_change":"2024-06-13T11:37:56.335836+0000","last_active":"2024-06-13T11:37:56.336735+0000","last_peered":"2024-06-13T11:37:56.336735+0000","last_clean":"2024-06-13T11:37:56.336735+0000","last_became_active":"2024-06-13T11:37:56.335541+0000","last_became_peered":"2024-06-13T11:37:56.335541+0000","last_unstale":"2024-06-13T11:37:56.336735+0000","last_undegraded":"2024-06-13T11:37:56.336735+0000","last_fullsized":"2024-06-13T11:37:56.336735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335147+0000","last_change":"2024-06-13T11:37:55.312146+0000","last_active":"2024-06-13T11:37:56.335147+0000","last_peered":"2024-06-13T11:37:56.335147+0000","last_clean":"2024-06-13T11:37:56.335147+0000","last_became_active":"2024-06-13T11:37:55.311692+0000","last_became_peered":"2024-06-13T11:37:55.311692+0000","last_unstale":"2024-06-13T11:37:56.335147+0000","last_undegraded":"2024-06-13T11:37:56.335147+0000","last_fullsized":"2024-06-13T11:37:56.335147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:52.165608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331247+0000","last_change":"2024-06-13T11:37:56.328733+0000","last_active":"2024-06-13T11:37:56.331247+0000","last_peered":"2024-06-13T11:37:56.331247+0000","last_clean":"2024-06-13T11:37:56.331247+0000","last_became_active":"2024-06-13T11:37:56.328353+0000","last_became_peered":"2024-06-13T11:37:56.328353+0000","last_unstale":"2024-06-13T11:37:56.331247+0000","last_undegraded":"2024-06-13T11:37:56.331247+0000","last_fullsized":"2024-06-13T11:37:56.331247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339092+0000","last_change":"2024-06-13T11:37:55.309442+0000","last_active":"2024-06-13T11:37:56.339092+0000","last_peered":"2024-06-13T11:37:56.339092+0000","last_clean":"2024-06-13T11:37:56.339092+0000","last_became_active":"2024-06-13T11:37:55.309109+0000","last_became_peered":"2024-06-13T11:37:55.309109+0000","last_unstale":"2024-06-13T11:37:56.339092+0000","last_undegraded":"2024-06-13T11:37:56.339092+0000","last_fullsized":"2024-06-13T11:37:56.339092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:55.069527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326115+0000","last_change":"2024-06-13T11:37:56.323618+0000","last_active":"2024-06-13T11:37:56.326115+0000","last_peered":"2024-06-13T11:37:56.326115+0000","last_clean":"2024-06-13T11:37:56.326115+0000","last_became_active":"2024-06-13T11:37:56.323333+0000","last_became_peered":"2024-06-13T11:37:56.323333+0000","last_unstale":"2024-06-13T11:37:56.326115+0000","last_undegraded":"2024-06-13T11:37:56.326115+0000","last_fullsized":"2024-06-13T11:37:56.326115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:39.954448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333494+0000","last_change":"2024-06-13T11:37:55.316960+0000","last_active":"2024-06-13T11:37:56.333494+0000","last_peered":"2024-06-13T11:37:56.333494+0000","last_clean":"2024-06-13T11:37:56.333494+0000","last_became_active":"2024-06-13T11:37:55.316663+0000","last_became_peered":"2024-06-13T11:37:55.316663+0000","last_unstale":"2024-06-13T11:37:56.333494+0000","last_undegraded":"2024-06-13T11:37:56.333494+0000","last_fullsized":"2024-06-13T11:37:56.333494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:06.986712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334322+0000","last_change":"2024-06-13T11:37:56.327997+0000","last_active":"2024-06-13T11:37:56.334322+0000","last_peered":"2024-06-13T11:37:56.334322+0000","last_clean":"2024-06-13T11:37:56.334322+0000","last_became_active":"2024-06-13T11:37:56.327722+0000","last_became_peered":"2024-06-13T11:37:56.327722+0000","last_unstale":"2024-06-13T11:37:56.334322+0000","last_undegraded":"2024-06-13T11:37:56.334322+0000","last_fullsized":"2024-06-13T11:37:56.334322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:58:30.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313590+0000","last_change":"2024-06-13T11:37:55.310340+0000","last_active":"2024-06-13T11:37:56.313590+0000","last_peered":"2024-06-13T11:37:56.313590+0000","last_clean":"2024-06-13T11:37:56.313590+0000","last_became_active":"2024-06-13T11:37:55.310063+0000","last_became_peered":"2024-06-13T11:37:55.310063+0000","last_unstale":"2024-06-13T11:37:56.313590+0000","last_undegraded":"2024-06-13T11:37:56.313590+0000","last_fullsized":"2024-06-13T11:37:56.313590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:38.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336464+0000","last_change":"2024-06-13T11:37:56.333319+0000","last_active":"2024-06-13T11:37:56.336464+0000","last_peered":"2024-06-13T11:37:56.336464+0000","last_clean":"2024-06-13T11:37:56.336464+0000","last_became_active":"2024-06-13T11:37:56.333028+0000","last_became_peered":"2024-06-13T11:37:56.333028+0000","last_unstale":"2024-06-13T11:37:56.336464+0000","last_undegraded":"2024-06-13T11:37:56.336464+0000","last_fullsized":"2024-06-13T11:37:56.336464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.299520+0000","last_change":"2024-06-13T11:37:54.299520+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.299520+0000","last_undegraded":"2024-06-13T11:37:54.299520+0000","last_fullsized":"2024-06-13T11:37:54.299520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333552+0000","last_change":"2024-06-13T11:37:56.330323+0000","last_active":"2024-06-13T11:37:56.333552+0000","last_peered":"2024-06-13T11:37:56.333552+0000","last_clean":"2024-06-13T11:37:56.333552+0000","last_became_active":"2024-06-13T11:37:56.330008+0000","last_became_peered":"2024-06-13T11:37:56.330008+0000","last_unstale":"2024-06-13T11:37:56.333552+0000","last_undegraded":"2024-06-13T11:37:56.333552+0000","last_fullsized":"2024-06-13T11:37:56.333552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:41:16.066555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339466+0000","last_change":"2024-06-13T11:37:55.317870+0000","last_active":"2024-06-13T11:37:56.339466+0000","last_peered":"2024-06-13T11:37:56.339466+0000","last_clean":"2024-06-13T11:37:56.339466+0000","last_became_active":"2024-06-13T11:37:55.317569+0000","last_became_peered":"2024-06-13T11:37:55.317569+0000","last_unstale":"2024-06-13T11:37:56.339466+0000","last_undegraded":"2024-06-13T11:37:56.339466+0000","last_fullsized":"2024-06-13T11:37:56.339466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320986+0000","last_change":"2024-06-13T11:37:56.318768+0000","last_active":"2024-06-13T11:37:56.320986+0000","last_peered":"2024-06-13T11:37:56.320986+0000","last_clean":"2024-06-13T11:37:56.320986+0000","last_became_active":"2024-06-13T11:37:56.318414+0000","last_became_peered":"2024-06-13T11:37:56.318414+0000","last_unstale":"2024-06-13T11:37:56.320986+0000","last_undegraded":"2024-06-13T11:37:56.320986+0000","last_fullsized":"2024-06-13T11:37:56.320986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:43.606286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.325219+0000","last_change":"2024-06-13T11:37:55.314832+0000","last_active":"2024-06-13T11:37:56.325219+0000","last_peered":"2024-06-13T11:37:56.325219+0000","last_clean":"2024-06-13T11:37:56.325219+0000","last_became_active":"2024-06-13T11:37:55.314553+0000","last_became_peered":"2024-06-13T11:37:55.314553+0000","last_unstale":"2024-06-13T11:37:56.325219+0000","last_undegraded":"2024-06-13T11:37:56.325219+0000","last_fullsized":"2024-06-13T11:37:56.325219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:33.732710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335202+0000","last_change":"2024-06-13T11:37:56.329960+0000","last_active":"2024-06-13T11:37:56.335202+0000","last_peered":"2024-06-13T11:37:56.335202+0000","last_clean":"2024-06-13T11:37:56.335202+0000","last_became_active":"2024-06-13T11:37:56.327480+0000","last_became_peered":"2024-06-13T11:37:56.327480+0000","last_unstale":"2024-06-13T11:37:56.335202+0000","last_undegraded":"2024-06-13T11:37:56.335202+0000","last_fullsized":"2024-06-13T11:37:56.335202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:45.975185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332385+0000","last_change":"2024-06-13T11:37:55.310530+0000","last_active":"2024-06-13T11:37:56.332385+0000","last_peered":"2024-06-13T11:37:56.332385+0000","last_clean":"2024-06-13T11:37:56.332385+0000","last_became_active":"2024-06-13T11:37:55.310267+0000","last_became_peered":"2024-06-13T11:37:55.310267+0000","last_unstale":"2024-06-13T11:37:56.332385+0000","last_undegraded":"2024-06-13T11:37:56.332385+0000","last_fullsized":"2024-06-13T11:37:56.332385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333960+0000","last_change":"2024-06-13T11:37:56.330670+0000","last_active":"2024-06-13T11:37:56.333960+0000","last_peered":"2024-06-13T11:37:56.333960+0000","last_clean":"2024-06-13T11:37:56.333960+0000","last_became_active":"2024-06-13T11:37:56.330391+0000","last_became_peered":"2024-06-13T11:37:56.330391+0000","last_unstale":"2024-06-13T11:37:56.333960+0000","last_undegraded":"2024-06-13T11:37:56.333960+0000","last_fullsized":"2024-06-13T11:37:56.333960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334822+0000","last_change":"2024-06-13T11:37:55.315973+0000","last_active":"2024-06-13T11:37:56.334822+0000","last_peered":"2024-06-13T11:37:56.334822+0000","last_clean":"2024-06-13T11:37:56.334822+0000","last_became_active":"2024-06-13T11:37:55.315613+0000","last_became_peered":"2024-06-13T11:37:55.315613+0000","last_unstale":"2024-06-13T11:37:56.334822+0000","last_undegraded":"2024-06-13T11:37:56.334822+0000","last_fullsized":"2024-06-13T11:37:56.334822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:39:13.330192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322587+0000","last_change":"2024-06-13T11:37:56.317844+0000","last_active":"2024-06-13T11:37:56.322587+0000","last_peered":"2024-06-13T11:37:56.322587+0000","last_clean":"2024-06-13T11:37:56.322587+0000","last_became_active":"2024-06-13T11:37:56.317533+0000","last_became_peered":"2024-06-13T11:37:56.317533+0000","last_unstale":"2024-06-13T11:37:56.322587+0000","last_undegraded":"2024-06-13T11:37:56.322587+0000","last_fullsized":"2024-06-13T11:37:56.322587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:20.305235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313660+0000","last_change":"2024-06-13T11:37:55.317261+0000","last_active":"2024-06-13T11:37:56.313660+0000","last_peered":"2024-06-13T11:37:56.313660+0000","last_clean":"2024-06-13T11:37:56.313660+0000","last_became_active":"2024-06-13T11:37:55.316983+0000","last_became_peered":"2024-06-13T11:37:55.316983+0000","last_unstale":"2024-06-13T11:37:56.313660+0000","last_undegraded":"2024-06-13T11:37:56.313660+0000","last_fullsized":"2024-06-13T11:37:56.313660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:19.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336402+0000","last_change":"2024-06-13T11:37:56.332777+0000","last_active":"2024-06-13T11:37:56.336402+0000","last_peered":"2024-06-13T11:37:56.336402+0000","last_clean":"2024-06-13T11:37:56.336402+0000","last_became_active":"2024-06-13T11:37:56.332287+0000","last_became_peered":"2024-06-13T11:37:56.332287+0000","last_unstale":"2024-06-13T11:37:56.336402+0000","last_undegraded":"2024-06-13T11:37:56.336402+0000","last_fullsized":"2024-06-13T11:37:56.336402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335535+0000","last_change":"2024-06-13T11:37:55.318031+0000","last_active":"2024-06-13T11:37:56.335535+0000","last_peered":"2024-06-13T11:37:56.335535+0000","last_clean":"2024-06-13T11:37:56.335535+0000","last_became_active":"2024-06-13T11:37:55.316716+0000","last_became_peered":"2024-06-13T11:37:55.316716+0000","last_unstale":"2024-06-13T11:37:56.335535+0000","last_undegraded":"2024-06-13T11:37:56.335535+0000","last_fullsized":"2024-06-13T11:37:56.335535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:54:29.089099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336951+0000","last_change":"2024-06-13T11:37:56.336329+0000","last_active":"2024-06-13T11:37:56.336951+0000","last_peered":"2024-06-13T11:37:56.336951+0000","last_clean":"2024-06-13T11:37:56.336951+0000","last_became_active":"2024-06-13T11:37:56.335972+0000","last_became_peered":"2024-06-13T11:37:56.335972+0000","last_unstale":"2024-06-13T11:37:56.336951+0000","last_undegraded":"2024-06-13T11:37:56.336951+0000","last_fullsized":"2024-06-13T11:37:56.336951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306671+0000","last_change":"2024-06-13T11:37:55.312486+0000","last_active":"2024-06-13T11:37:56.306671+0000","last_peered":"2024-06-13T11:37:56.306671+0000","last_clean":"2024-06-13T11:37:56.306671+0000","last_became_active":"2024-06-13T11:37:55.312206+0000","last_became_peered":"2024-06-13T11:37:55.312206+0000","last_unstale":"2024-06-13T11:37:56.306671+0000","last_undegraded":"2024-06-13T11:37:56.306671+0000","last_fullsized":"2024-06-13T11:37:56.306671+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:14:01.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315037+0000","last_change":"2024-06-13T11:37:56.313649+0000","last_active":"2024-06-13T11:37:56.315037+0000","last_peered":"2024-06-13T11:37:56.315037+0000","last_clean":"2024-06-13T11:37:56.315037+0000","last_became_active":"2024-06-13T11:37:56.313376+0000","last_became_peered":"2024-06-13T11:37:56.313376+0000","last_unstale":"2024-06-13T11:37:56.315037+0000","last_undegraded":"2024-06-13T11:37:56.315037+0000","last_fullsized":"2024-06-13T11:37:56.315037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320310+0000","last_change":"2024-06-13T11:37:55.315779+0000","last_active":"2024-06-13T11:37:56.320310+0000","last_peered":"2024-06-13T11:37:56.320310+0000","last_clean":"2024-06-13T11:37:56.320310+0000","last_became_active":"2024-06-13T11:37:55.315487+0000","last_became_peered":"2024-06-13T11:37:55.315487+0000","last_unstale":"2024-06-13T11:37:56.320310+0000","last_undegraded":"2024-06-13T11:37:56.320310+0000","last_fullsized":"2024-06-13T11:37:56.320310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334552+0000","last_change":"2024-06-13T11:37:56.332594+0000","last_active":"2024-06-13T11:37:56.334552+0000","last_peered":"2024-06-13T11:37:56.334552+0000","last_clean":"2024-06-13T11:37:56.334552+0000","last_became_active":"2024-06-13T11:37:56.332265+0000","last_became_peered":"2024-06-13T11:37:56.332265+0000","last_unstale":"2024-06-13T11:37:56.334552+0000","last_undegraded":"2024-06-13T11:37:56.334552+0000","last_fullsized":"2024-06-13T11:37:56.334552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:04:56.197473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306156+0000","last_change":"2024-06-13T11:37:55.314354+0000","last_active":"2024-06-13T11:37:56.306156+0000","last_peered":"2024-06-13T11:37:56.306156+0000","last_clean":"2024-06-13T11:37:56.306156+0000","last_became_active":"2024-06-13T11:37:55.314034+0000","last_became_peered":"2024-06-13T11:37:55.314034+0000","last_unstale":"2024-06-13T11:37:56.306156+0000","last_undegraded":"2024-06-13T11:37:56.306156+0000","last_fullsized":"2024-06-13T11:37:56.306156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:29.902564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321709+0000","last_change":"2024-06-13T11:37:56.318282+0000","last_active":"2024-06-13T11:37:56.321709+0000","last_peered":"2024-06-13T11:37:56.321709+0000","last_clean":"2024-06-13T11:37:56.321709+0000","last_became_active":"2024-06-13T11:37:56.317985+0000","last_became_peered":"2024-06-13T11:37:56.317985+0000","last_unstale":"2024-06-13T11:37:56.321709+0000","last_undegraded":"2024-06-13T11:37:56.321709+0000","last_fullsized":"2024-06-13T11:37:56.321709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.323334+0000","last_change":"2024-06-13T11:37:55.313951+0000","last_active":"2024-06-13T11:37:56.323334+0000","last_peered":"2024-06-13T11:37:56.323334+0000","last_clean":"2024-06-13T11:37:56.323334+0000","last_became_active":"2024-06-13T11:37:55.313509+0000","last_became_peered":"2024-06-13T11:37:55.313509+0000","last_unstale":"2024-06-13T11:37:56.323334+0000","last_undegraded":"2024-06-13T11:37:56.323334+0000","last_fullsized":"2024-06-13T11:37:56.323334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:26.188457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336553+0000","last_change":"2024-06-13T11:37:56.333448+0000","last_active":"2024-06-13T11:37:56.336553+0000","last_peered":"2024-06-13T11:37:56.336553+0000","last_clean":"2024-06-13T11:37:56.336553+0000","last_became_active":"2024-06-13T11:37:56.332703+0000","last_became_peered":"2024-06-13T11:37:56.332703+0000","last_unstale":"2024-06-13T11:37:56.336553+0000","last_undegraded":"2024-06-13T11:37:56.336553+0000","last_fullsized":"2024-06-13T11:37:56.336553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306065+0000","last_change":"2024-06-13T11:37:55.310716+0000","last_active":"2024-06-13T11:37:56.306065+0000","last_peered":"2024-06-13T11:37:56.306065+0000","last_clean":"2024-06-13T11:37:56.306065+0000","last_became_active":"2024-06-13T11:37:55.310423+0000","last_became_peered":"2024-06-13T11:37:55.310423+0000","last_unstale":"2024-06-13T11:37:56.306065+0000","last_undegraded":"2024-06-13T11:37:56.306065+0000","last_fullsized":"2024-06-13T11:37:56.306065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:17:20.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324450+0000","last_change":"2024-06-13T11:37:56.323367+0000","last_active":"2024-06-13T11:37:56.324450+0000","last_peered":"2024-06-13T11:37:56.324450+0000","last_clean":"2024-06-13T11:37:56.324450+0000","last_became_active":"2024-06-13T11:37:56.323061+0000","last_became_peered":"2024-06-13T11:37:56.323061+0000","last_unstale":"2024-06-13T11:37:56.324450+0000","last_undegraded":"2024-06-13T11:37:56.324450+0000","last_fullsized":"2024-06-13T11:37:56.324450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:14:31.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315192+0000","last_change":"2024-06-13T11:37:55.316693+0000","last_active":"2024-06-13T11:37:56.315192+0000","last_peered":"2024-06-13T11:37:56.315192+0000","last_clean":"2024-06-13T11:37:56.315192+0000","last_became_active":"2024-06-13T11:37:55.316352+0000","last_became_peered":"2024-06-13T11:37:55.316352+0000","last_unstale":"2024-06-13T11:37:56.315192+0000","last_undegraded":"2024-06-13T11:37:56.315192+0000","last_fullsized":"2024-06-13T11:37:56.315192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332807+0000","last_change":"2024-06-13T11:37:56.330835+0000","last_active":"2024-06-13T11:37:56.332807+0000","last_peered":"2024-06-13T11:37:56.332807+0000","last_clean":"2024-06-13T11:37:56.332807+0000","last_became_active":"2024-06-13T11:37:56.330558+0000","last_became_peered":"2024-06-13T11:37:56.330558+0000","last_unstale":"2024-06-13T11:37:56.332807+0000","last_undegraded":"2024-06-13T11:37:56.332807+0000","last_fullsized":"2024-06-13T11:37:56.332807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314791+0000","last_change":"2024-06-13T11:37:55.317955+0000","last_active":"2024-06-13T11:37:56.314791+0000","last_peered":"2024-06-13T11:37:56.314791+0000","last_clean":"2024-06-13T11:37:56.314791+0000","last_became_active":"2024-06-13T11:37:55.317670+0000","last_became_peered":"2024-06-13T11:37:55.317670+0000","last_unstale":"2024-06-13T11:37:56.314791+0000","last_undegraded":"2024-06-13T11:37:56.314791+0000","last_fullsized":"2024-06-13T11:37:56.314791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:49.054318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328843+0000","last_change":"2024-06-13T11:37:56.327970+0000","last_active":"2024-06-13T11:37:56.328843+0000","last_peered":"2024-06-13T11:37:56.328843+0000","last_clean":"2024-06-13T11:37:56.328843+0000","last_became_active":"2024-06-13T11:37:56.327680+0000","last_became_peered":"2024-06-13T11:37:56.327680+0000","last_unstale":"2024-06-13T11:37:56.328843+0000","last_undegraded":"2024-06-13T11:37:56.328843+0000","last_fullsized":"2024-06-13T11:37:56.328843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-06-13T11:37:54.299492+0000","last_change":"2024-06-13T11:37:54.299492+0000","last_active":"2024-06-13T11:37:54.287887+0000","last_peered":"2024-06-13T11:37:54.287887+0000","last_clean":"2024-06-13T11:37:54.287887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-13T11:37:54.299492+0000","last_undegraded":"2024-06-13T11:37:54.299492+0000","last_fullsized":"2024-06-13T11:37:54.299492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328974+0000","last_change":"2024-06-13T11:37:56.325514+0000","last_active":"2024-06-13T11:37:56.328974+0000","last_peered":"2024-06-13T11:37:56.328974+0000","last_clean":"2024-06-13T11:37:56.328974+0000","last_became_active":"2024-06-13T11:37:56.324920+0000","last_became_peered":"2024-06-13T11:37:56.324920+0000","last_unstale":"2024-06-13T11:37:56.328974+0000","last_undegraded":"2024-06-13T11:37:56.328974+0000","last_fullsized":"2024-06-13T11:37:56.328974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:22.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315670+0000","last_change":"2024-06-13T11:37:55.308637+0000","last_active":"2024-06-13T11:37:56.315670+0000","last_peered":"2024-06-13T11:37:56.315670+0000","last_clean":"2024-06-13T11:37:56.315670+0000","last_became_active":"2024-06-13T11:37:55.308361+0000","last_became_peered":"2024-06-13T11:37:55.308361+0000","last_unstale":"2024-06-13T11:37:56.315670+0000","last_undegraded":"2024-06-13T11:37:56.315670+0000","last_fullsized":"2024-06-13T11:37:56.315670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336100+0000","last_change":"2024-06-13T11:37:56.332842+0000","last_active":"2024-06-13T11:37:56.336100+0000","last_peered":"2024-06-13T11:37:56.336100+0000","last_clean":"2024-06-13T11:37:56.336100+0000","last_became_active":"2024-06-13T11:37:56.332557+0000","last_became_peered":"2024-06-13T11:37:56.332557+0000","last_unstale":"2024-06-13T11:37:56.336100+0000","last_undegraded":"2024-06-13T11:37:56.336100+0000","last_fullsized":"2024-06-13T11:37:56.336100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.310725+0000","last_change":"2024-06-13T11:37:55.315564+0000","last_active":"2024-06-13T11:37:56.310725+0000","last_peered":"2024-06-13T11:37:56.310725+0000","last_clean":"2024-06-13T11:37:56.310725+0000","last_became_active":"2024-06-13T11:37:55.313545+0000","last_became_peered":"2024-06-13T11:37:55.313545+0000","last_unstale":"2024-06-13T11:37:56.310725+0000","last_undegraded":"2024-06-13T11:37:56.310725+0000","last_fullsized":"2024-06-13T11:37:56.310725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:46.960127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322853+0000","last_change":"2024-06-13T11:37:56.319494+0000","last_active":"2024-06-13T11:37:56.322853+0000","last_peered":"2024-06-13T11:37:56.322853+0000","last_clean":"2024-06-13T11:37:56.322853+0000","last_became_active":"2024-06-13T11:37:56.319182+0000","last_became_peered":"2024-06-13T11:37:56.319182+0000","last_unstale":"2024-06-13T11:37:56.322853+0000","last_undegraded":"2024-06-13T11:37:56.322853+0000","last_fullsized":"2024-06-13T11:37:56.322853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320500+0000","last_change":"2024-06-13T11:37:55.318759+0000","last_active":"2024-06-13T11:37:56.320500+0000","last_peered":"2024-06-13T11:37:56.320500+0000","last_clean":"2024-06-13T11:37:56.320500+0000","last_became_active":"2024-06-13T11:37:55.318420+0000","last_became_peered":"2024-06-13T11:37:55.318420+0000","last_unstale":"2024-06-13T11:37:56.320500+0000","last_undegraded":"2024-06-13T11:37:56.320500+0000","last_fullsized":"2024-06-13T11:37:56.320500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:21.172360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319200+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:56.319200+0000","last_peered":"2024-06-13T11:37:56.319200+0000","last_clean":"2024-06-13T11:37:56.319200+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:56.319200+0000","last_undegraded":"2024-06-13T11:37:56.319200+0000","last_fullsized":"2024-06-13T11:37:56.319200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":172124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":152011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:38:01.055 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-06-13T11:38:01.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-13T11:37:55.292803+0000', 'last_change': '2024-06-13T11:37:55.292803+0000', 'last_active': '2024-06-13T11:37:55.292803+0000', 'last_peered': '2024-06-13T11:37:55.292803+0000', 'last_clean': '2024-06-13T11:37:55.292803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:55.292803+0000', 'last_undegraded': '2024-06-13T11:37:55.292803+0000', 'last_fullsized': '2024-06-13T11:37:55.292803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-13T11:38:01.055 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-06-13T11:38:01.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-13T11:37:55.292803+0000', 'last_change': '2024-06-13T11:37:55.292803+0000', 'last_active': '2024-06-13T11:37:55.292803+0000', 'last_peered': '2024-06-13T11:37:55.292803+0000', 'last_clean': '2024-06-13T11:37:55.292803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:55.292803+0000', 'last_undegraded': '2024-06-13T11:37:55.292803+0000', 'last_fullsized': '2024-06-13T11:37:55.292803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-13T11:38:01.055 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-13T11:37:55.292803+0000', 'last_change': '2024-06-13T11:37:55.292803+0000', 'last_active': '2024-06-13T11:37:55.292803+0000', 'last_peered': '2024-06-13T11:37:55.292803+0000', 'last_clean': '2024-06-13T11:37:55.292803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:55.292803+0000', 'last_undegraded': '2024-06-13T11:37:55.292803+0000', 'last_fullsized': '2024-06-13T11:37:55.292803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-13T11:37:55.292803+0000', 'last_change': '2024-06-13T11:37:55.292803+0000', 'last_active': '2024-06-13T11:37:55.292803+0000', 'last_peered': '2024-06-13T11:37:55.292803+0000', 'last_clean': '2024-06-13T11:37:55.292803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:55.292803+0000', 'last_undegraded': '2024-06-13T11:37:55.292803+0000', 'last_fullsized': '2024-06-13T11:37:55.292803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-13T11:37:55.292803+0000', 'last_change': '2024-06-13T11:37:55.292803+0000', 'last_active': '2024-06-13T11:37:55.292803+0000', 'last_peered': '2024-06-13T11:37:55.292803+0000', 'last_clean': '2024-06-13T11:37:55.292803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:55.292803+0000', 'last_undegraded': '2024-06-13T11:37:55.292803+0000', 'last_fullsized': '2024-06-13T11:37:55.292803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-13T11:37:55.292803+0000', 'last_change': '2024-06-13T11:37:55.292803+0000', 'last_active': '2024-06-13T11:37:55.292803+0000', 'last_peered': '2024-06-13T11:37:55.292803+0000', 'last_clean': '2024-06-13T11:37:55.292803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:55.292803+0000', 'last_undegraded': '2024-06-13T11:37:55.292803+0000', 'last_fullsized': '2024-06-13T11:37:55.292803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:55.292803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-06-13T11:37:54.300009+0000', 'last_change': '2024-06-13T11:37:54.300009+0000', 'last_active': '2024-06-13T11:37:54.287887+0000', 'last_peered': '2024-06-13T11:37:54.287887+0000', 'last_clean': '2024-06-13T11:37:54.287887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:54.300009+0000', 'last_undegraded': '2024-06-13T11:37:54.300009+0000', 'last_fullsized': '2024-06-13T11:37:54.300009+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-06-13T11:37:54.299520+0000', 'last_change': '2024-06-13T11:37:54.299520+0000', 'last_active': '2024-06-13T11:37:54.287887+0000', 'last_peered': '2024-06-13T11:37:54.287887+0000', 'last_clean': '2024-06-13T11:37:54.287887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:54.299520+0000', 'last_undegraded': '2024-06-13T11:37:54.299520+0000', 'last_fullsized': '2024-06-13T11:37:54.299520+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-06-13T11:38:01.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-06-13T11:37:54.299492+0000', 'last_change': '2024-06-13T11:37:54.299492+0000', 'last_active': '2024-06-13T11:37:54.287887+0000', 'last_peered': '2024-06-13T11:37:54.287887+0000', 'last_clean': '2024-06-13T11:37:54.287887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-13T11:37:54.299492+0000', 'last_undegraded': '2024-06-13T11:37:54.299492+0000', 'last_fullsized': '2024-06-13T11:37:54.299492+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'last_clean_scrub_stamp': '2024-06-13T11:37:54.287887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-13T11:38:01.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-13T11:38:01.113 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T11:38:01.114+0000 7fe59517b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-13T11:38:01.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.195+0000 7ff2966cd640 1 Processor -- start 2024-06-13T11:38:01.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.195+0000 7ff2966cd640 1 -- start start 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff2966cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff29015c250 0x7ff290071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff2966cd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff2900cf580 0x7ff2900a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff2966cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2900b09f0 con 0x7ff290072b90 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff2966cd640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff290072700 con 0x7ff2900cf580 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff2966cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff290071dd0 con 0x7ff29015c250 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff294c6a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff2900cf580 0x7ff2900a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff294c6a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff2900cf580 0x7ff2900a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55058/0 (socket says 172.21.15.43:55058) 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.196+0000 7ff294c6a640 1 -- 172.21.15.43:0/2464819757 learned_addr learned my addr 172.21.15.43:0/2464819757 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff28ffff640 1 --2- 172.21.15.43:0/2464819757 >> v2:172.21.15.53:3300/0 conn(0x7ff29015c250 0x7ff290071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff294c6a640 1 -- 172.21.15.43:0/2464819757 >> v2:172.21.15.53:3300/0 conn(0x7ff29015c250 msgr2=0x7ff290071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff294c6a640 1 --2- 172.21.15.43:0/2464819757 >> v2:172.21.15.53:3300/0 conn(0x7ff29015c250 0x7ff290071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff294c6a640 1 -- 172.21.15.43:0/2464819757 >> v1:172.21.15.53:6789/0 conn(0x7ff290072b90 legacy=0x7ff2900cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff294c6a640 1 -- 172.21.15.43:0/2464819757 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900720b0 con 0x7ff2900cf580 2024-06-13T11:38:01.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff28ffff640 1 --2- 172.21.15.43:0/2464819757 >> v2:172.21.15.53:3300/0 conn(0x7ff29015c250 0x7ff290071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.197+0000 7ff294c6a640 1 --2- 172.21.15.43:0/2464819757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2900cf580 0x7ff2900a9490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff2900cfdd0 tx=0x7ff28802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91b39b570695a07 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff28effd640 1 -- 172.21.15.43:0/2464819757 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288036070 con 0x7ff2900cf580 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff28effd640 1 -- 172.21.15.43:0/2464819757 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288031600 con 0x7ff2900cf580 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff28effd640 1 -- 172.21.15.43:0/2464819757 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880319d0 con 0x7ff2900cf580 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 -- 172.21.15.43:0/2464819757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2900cf580 msgr2=0x7ff2900a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 --2- 172.21.15.43:0/2464819757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2900cf580 0x7ff2900a9490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff2900cfdd0 tx=0x7ff28802a6f0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 -- 172.21.15.43:0/2464819757 shutdown_connections 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 --2- 172.21.15.43:0/2464819757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2900cf580 0x7ff2900a9490 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 --2- 172.21.15.43:0/2464819757 >> v2:172.21.15.53:3300/0 conn(0x7ff29015c250 0x7ff290071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 -- 172.21.15.43:0/2464819757 >> 172.21.15.43:0/2464819757 conn(0x7ff2900b14b0 msgr2=0x7ff2900b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:01.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 -- 172.21.15.43:0/2464819757 shutdown_connections 2024-06-13T11:38:01.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.198+0000 7ff2966cd640 1 -- 172.21.15.43:0/2464819757 wait complete. 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.199+0000 7ff2966cd640 1 Processor -- start 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.199+0000 7ff2966cd640 1 -- start start 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff2966cd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 0x7ff2901499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff2966cd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2900cf580 0x7ff2900ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff2966cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff29015c250 0x7ff29015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff2966cd640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff29015c7b0 con 0x7ff290072b90 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff2966cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff29015c630 con 0x7ff29015c250 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff2966cd640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff2900b0e30 con 0x7ff2900cf580 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff28ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 0x7ff2901499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff28ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 0x7ff2901499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55070/0 (socket says 172.21.15.43:55070) 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.200+0000 7ff28ffff640 1 -- 172.21.15.43:0/802842216 learned_addr learned my addr 172.21.15.43:0/802842216 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff294c6a640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff29015c250 0x7ff29015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28f7fe640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2900cf580 0x7ff2900ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28ffff640 1 -- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2900cf580 msgr2=0x7ff2900ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28ffff640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2900cf580 0x7ff2900ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28ffff640 1 -- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff29015c250 msgr2=0x7ff29015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28ffff640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff29015c250 0x7ff29015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28ffff640 1 -- 172.21.15.43:0/802842216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900aeaf0 con 0x7ff290072b90 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff294c6a640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff29015c250 0x7ff29015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28f7fe640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2900cf580 0x7ff2900ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28ffff640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 0x7ff2901499b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c7f0 tx=0x7ff28000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280015070 con 0x7ff290072b90 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff280007820 con 0x7ff290072b90 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2900aedd0 con 0x7ff290072b90 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280007bd0 con 0x7ff290072b90 2024-06-13T11:38:01.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.201+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2900af390 con 0x7ff290072b90 2024-06-13T11:38:01.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.202+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29004ffb0 con 0x7ff290072b90 2024-06-13T11:38:01.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.203+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff280018070 con 0x7ff290072b90 2024-06-13T11:38:01.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.203+0000 7ff28cff9640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff27c06be30 0x7ff27c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.203+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff28008aea0 con 0x7ff290072b90 2024-06-13T11:38:01.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.203+0000 7ff28f7fe640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff27c06be30 0x7ff27c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.204+0000 7ff28f7fe640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff27c06be30 0x7ff27c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2901f5710 tx=0x7ff284009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:01.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.207+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff280059750 con 0x7ff290072b90 2024-06-13T11:38:01.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.460+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff290160dd0 con 0x7ff290072b90 2024-06-13T11:38:01.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.461+0000 7ff28cff9640 1 -- 172.21.15.43:0/802842216 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2787 (secure 0 0 0) 0x7ff280059050 con 0x7ff290072b90 2024-06-13T11:38:01.460 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:01.460 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":70,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1718278620,"num_in_osds":8,"osd_in_since":1718278613,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"unknown","count":6},{"state_name":"creating+peering","count":3}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592196,"bytes_used":259809280,"bytes_avail":772834304000,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.030927835032343864,"write_bytes_sec":2626,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4926}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-06-13T11:37:57.360718+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-13T11:38:01.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff27c06be30 msgr2=0x7ff27c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff27c06be30 0x7ff27c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2901f5710 tx=0x7ff284009040 comp rx=0 tx=0).stop 2024-06-13T11:38:01.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 msgr2=0x7ff2901499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 0x7ff2901499b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c7f0 tx=0x7ff28000ccb0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 shutdown_connections 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff27c06be30 0x7ff27c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff29015c250 0x7ff29015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff2900cf580 0x7ff2900ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 --2- 172.21.15.43:0/802842216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff290072b90 0x7ff2901499b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 >> 172.21.15.43:0/802842216 conn(0x7ff2900b14b0 msgr2=0x7ff29006e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 shutdown_connections 2024-06-13T11:38:01.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.463+0000 7ff2966cd640 1 -- 172.21.15.43:0/802842216 wait complete. 2024-06-13T11:38:01.473 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-13T11:38:01.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:38:01.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.577+0000 7ff985cd4640 1 Processor -- start 2024-06-13T11:38:01.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 -- start start 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff980155420 0x7ff9800ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9800ae9c0 0x7ff9800d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800d2fd0 0x7ff980161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff9800aa5d0 con 0x7ff9800ae9c0 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff980155800 con 0x7ff980155420 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.578+0000 7ff985cd4640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff9800aa870 con 0x7ff9800d2fd0 2024-06-13T11:38:01.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9800ae9c0 0x7ff9800d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9800ae9c0 0x7ff9800d2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55074/0 (socket says 172.21.15.43:55074) 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 -- 172.21.15.43:0/521249924 learned_addr learned my addr 172.21.15.43:0/521249924 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 -- 172.21.15.43:0/521249924 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800d2fd0 msgr2=0x7ff980161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97ffff640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800d2fd0 0x7ff980161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97f7fe640 1 --2- 172.21.15.43:0/521249924 >> v2:172.21.15.53:3300/0 conn(0x7ff980155420 0x7ff9800ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800d2fd0 0x7ff980161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 -- 172.21.15.43:0/521249924 >> v2:172.21.15.53:3300/0 conn(0x7ff980155420 msgr2=0x7ff9800ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 --2- 172.21.15.43:0/521249924 >> v2:172.21.15.53:3300/0 conn(0x7ff980155420 0x7ff9800ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97effd640 1 -- 172.21.15.43:0/521249924 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9800aab50 con 0x7ff9800ae9c0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97f7fe640 1 --2- 172.21.15.43:0/521249924 >> v2:172.21.15.53:3300/0 conn(0x7ff980155420 0x7ff9800ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.579+0000 7ff97ffff640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800d2fd0 0x7ff980161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.580+0000 7ff97effd640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800ae9c0 0x7ff9800d2a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff9800d2a60 tx=0x7ff97402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a97318cae0fe719 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.580+0000 7ff97e7fc640 1 -- 172.21.15.43:0/521249924 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037070 con 0x7ff9800ae9c0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.580+0000 7ff97e7fc640 1 -- 172.21.15.43:0/521249924 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974032440 con 0x7ff9800ae9c0 2024-06-13T11:38:01.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.580+0000 7ff97e7fc640 1 -- 172.21.15.43:0/521249924 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974032810 con 0x7ff9800ae9c0 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.580+0000 7ff985cd4640 1 -- 172.21.15.43:0/521249924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800ae9c0 msgr2=0x7ff9800d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.580+0000 7ff985cd4640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800ae9c0 0x7ff9800d2a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff9800d2a60 tx=0x7ff97402a1e0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 -- 172.21.15.43:0/521249924 shutdown_connections 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800d2fd0 0x7ff980161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 --2- 172.21.15.43:0/521249924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800ae9c0 0x7ff9800d2a90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 --2- 172.21.15.43:0/521249924 >> v2:172.21.15.53:3300/0 conn(0x7ff980155420 0x7ff9800ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 -- 172.21.15.43:0/521249924 >> 172.21.15.43:0/521249924 conn(0x7ff980067640 msgr2=0x7ff9800d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 -- 172.21.15.43:0/521249924 shutdown_connections 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.581+0000 7ff985cd4640 1 -- 172.21.15.43:0/521249924 wait complete. 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.582+0000 7ff985cd4640 1 Processor -- start 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.582+0000 7ff985cd4640 1 -- start start 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff985cd4640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800ae9c0 0x7ff98015a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff985cd4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 0x7ff980157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff985cd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff980155420 0x7ff980147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff985cd4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9800ab630 con 0x7ff9800d2fd0 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff985cd4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff9800ab110 con 0x7ff980155420 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff985cd4640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff9800adfb0 con 0x7ff9800ae9c0 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 0x7ff980157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 0x7ff980157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55078/0 (socket says 172.21.15.43:55078) 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 -- 172.21.15.43:0/551787211 learned_addr learned my addr 172.21.15.43:0/551787211 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97ffff640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff980155420 0x7ff980147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97f7fe640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800ae9c0 0x7ff98015a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 -- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800ae9c0 msgr2=0x7ff98015a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800ae9c0 0x7ff98015a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 -- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff980155420 msgr2=0x7ff980147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff980155420 0x7ff980147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 -- 172.21.15.43:0/551787211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98015a730 con 0x7ff9800d2fd0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.583+0000 7ff97effd640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 0x7ff980157e50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff97402a220 tx=0x7ff9740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.584+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037040 con 0x7ff9800d2fd0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.584+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974042070 con 0x7ff9800d2fd0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.584+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98015aa10 con 0x7ff9800d2fd0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.584+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974030bb0 con 0x7ff9800d2fd0 2024-06-13T11:38:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.584+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98015afd0 con 0x7ff9800d2fd0 2024-06-13T11:38:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.585+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98004ffb0 con 0x7ff9800d2fd0 2024-06-13T11:38:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.585+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff974047460 con 0x7ff9800d2fd0 2024-06-13T11:38:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.586+0000 7ff967fff640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff96c06be30 0x7ff96c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.586+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff9740abc20 con 0x7ff9800d2fd0 2024-06-13T11:38:01.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.586+0000 7ff97f7fe640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff96c06be30 0x7ff96c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:01.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.586+0000 7ff97f7fe640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff96c06be30 0x7ff96c06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff97000a950 tx=0x7ff970008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:01.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.590+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff974045360 con 0x7ff9800d2fd0 2024-06-13T11:38:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.775+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9800b45d0 con 0x7ff96c06be30 2024-06-13T11:38:01.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.782+0000 7ff967fff640 1 -- 172.21.15.43:0/551787211 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7ff9800b45d0 con 0x7ff96c06be30 2024-06-13T11:38:01.784 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:01.785 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:38:01.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.785+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff96c06be30 msgr2=0x7ff96c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.785+0000 7ff985cd4640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff96c06be30 0x7ff96c06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff97000a950 tx=0x7ff970008040 comp rx=0 tx=0).stop 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.785+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 msgr2=0x7ff980157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.785+0000 7ff985cd4640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 0x7ff980157e50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff97402a220 tx=0x7ff9740046c0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 shutdown_connections 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff96c06be30 0x7ff96c06e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff980155420 0x7ff980147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9800d2fd0 0x7ff980157e50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 --2- 172.21.15.43:0/551787211 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9800ae9c0 0x7ff98015a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 >> 172.21.15.43:0/551787211 conn(0x7ff980067640 msgr2=0x7ff9800b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 shutdown_connections 2024-06-13T11:38:01.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:01.786+0000 7ff985cd4640 1 -- 172.21.15.43:0/551787211 wait complete. 2024-06-13T11:38:01.796 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-06-13T11:38:01.361372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253772,"kb_used_data":4308,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720948,"statfs":{"total":773094113280,"available":772834250752,"internally_reserved":0,"allocated":4411392,"data_stored":2521510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.065359"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324984+0000","last_change":"2024-06-13T11:37:56.323330+0000","last_active":"2024-06-13T11:37:56.324984+0000","last_peered":"2024-06-13T11:37:56.324984+0000","last_clean":"2024-06-13T11:37:56.324984+0000","last_became_active":"2024-06-13T11:37:56.323036+0000","last_became_peered":"2024-06-13T11:37:56.323036+0000","last_unstale":"2024-06-13T11:37:56.324984+0000","last_undegraded":"2024-06-13T11:37:56.324984+0000","last_fullsized":"2024-06-13T11:37:56.324984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:21:41.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.318958+0000","last_change":"2024-06-13T11:37:56.317705+0000","last_active":"2024-06-13T11:37:56.318958+0000","last_peered":"2024-06-13T11:37:56.318958+0000","last_clean":"2024-06-13T11:37:56.318958+0000","last_became_active":"2024-06-13T11:37:56.317411+0000","last_became_peered":"2024-06-13T11:37:56.317411+0000","last_unstale":"2024-06-13T11:37:56.318958+0000","last_undegraded":"2024-06-13T11:37:56.318958+0000","last_fullsized":"2024-06-13T11:37:56.318958+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332928+0000","last_change":"2024-06-13T11:37:56.331226+0000","last_active":"2024-06-13T11:37:56.332928+0000","last_peered":"2024-06-13T11:37:56.332928+0000","last_clean":"2024-06-13T11:37:56.332928+0000","last_became_active":"2024-06-13T11:37:56.330954+0000","last_became_peered":"2024-06-13T11:37:56.330954+0000","last_unstale":"2024-06-13T11:37:56.332928+0000","last_undegraded":"2024-06-13T11:37:56.332928+0000","last_fullsized":"2024-06-13T11:37:56.332928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333203+0000","last_change":"2024-06-13T11:37:56.328375+0000","last_active":"2024-06-13T11:37:56.333203+0000","last_peered":"2024-06-13T11:37:56.333203+0000","last_clean":"2024-06-13T11:37:56.333203+0000","last_became_active":"2024-06-13T11:37:56.327777+0000","last_became_peered":"2024-06-13T11:37:56.327777+0000","last_unstale":"2024-06-13T11:37:56.333203+0000","last_undegraded":"2024-06-13T11:37:56.333203+0000","last_fullsized":"2024-06-13T11:37:56.333203+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:09:44.669303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333007+0000","last_change":"2024-06-13T11:37:56.330392+0000","last_active":"2024-06-13T11:37:56.333007+0000","last_peered":"2024-06-13T11:37:56.333007+0000","last_clean":"2024-06-13T11:37:56.333007+0000","last_became_active":"2024-06-13T11:37:56.330114+0000","last_became_peered":"2024-06-13T11:37:56.330114+0000","last_unstale":"2024-06-13T11:37:56.333007+0000","last_undegraded":"2024-06-13T11:37:56.333007+0000","last_fullsized":"2024-06-13T11:37:56.333007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:42.005975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320115+0000","last_change":"2024-06-13T11:37:56.316382+0000","last_active":"2024-06-13T11:37:56.320115+0000","last_peered":"2024-06-13T11:37:56.320115+0000","last_clean":"2024-06-13T11:37:56.320115+0000","last_became_active":"2024-06-13T11:37:56.316079+0000","last_became_peered":"2024-06-13T11:37:56.316079+0000","last_unstale":"2024-06-13T11:37:56.320115+0000","last_undegraded":"2024-06-13T11:37:56.320115+0000","last_fullsized":"2024-06-13T11:37:56.320115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322531+0000","last_change":"2024-06-13T11:37:56.320153+0000","last_active":"2024-06-13T11:37:56.322531+0000","last_peered":"2024-06-13T11:37:56.322531+0000","last_clean":"2024-06-13T11:37:56.322531+0000","last_became_active":"2024-06-13T11:37:56.319164+0000","last_became_peered":"2024-06-13T11:37:56.319164+0000","last_unstale":"2024-06-13T11:37:56.322531+0000","last_undegraded":"2024-06-13T11:37:56.322531+0000","last_fullsized":"2024-06-13T11:37:56.322531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333612+0000","last_change":"2024-06-13T11:37:56.329963+0000","last_active":"2024-06-13T11:37:56.333612+0000","last_peered":"2024-06-13T11:37:56.333612+0000","last_clean":"2024-06-13T11:37:56.333612+0000","last_became_active":"2024-06-13T11:37:56.329661+0000","last_became_peered":"2024-06-13T11:37:56.329661+0000","last_unstale":"2024-06-13T11:37:56.333612+0000","last_undegraded":"2024-06-13T11:37:56.333612+0000","last_fullsized":"2024-06-13T11:37:56.333612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:33:06.820994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326642+0000","last_change":"2024-06-13T11:37:56.323714+0000","last_active":"2024-06-13T11:37:56.326642+0000","last_peered":"2024-06-13T11:37:56.326642+0000","last_clean":"2024-06-13T11:37:56.326642+0000","last_became_active":"2024-06-13T11:37:56.323416+0000","last_became_peered":"2024-06-13T11:37:56.323416+0000","last_unstale":"2024-06-13T11:37:56.326642+0000","last_undegraded":"2024-06-13T11:37:56.326642+0000","last_fullsized":"2024-06-13T11:37:56.326642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:20.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.330128+0000","last_change":"2024-06-13T11:37:56.326263+0000","last_active":"2024-06-13T11:37:56.330128+0000","last_peered":"2024-06-13T11:37:56.330128+0000","last_clean":"2024-06-13T11:37:56.330128+0000","last_became_active":"2024-06-13T11:37:56.325928+0000","last_became_peered":"2024-06-13T11:37:56.325928+0000","last_unstale":"2024-06-13T11:37:56.330128+0000","last_undegraded":"2024-06-13T11:37:56.330128+0000","last_fullsized":"2024-06-13T11:37:56.330128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:28.052669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335071+0000","last_change":"2024-06-13T11:37:56.328875+0000","last_active":"2024-06-13T11:37:56.335071+0000","last_peered":"2024-06-13T11:37:56.335071+0000","last_clean":"2024-06-13T11:37:56.335071+0000","last_became_active":"2024-06-13T11:37:56.328466+0000","last_became_peered":"2024-06-13T11:37:56.328466+0000","last_unstale":"2024-06-13T11:37:56.335071+0000","last_undegraded":"2024-06-13T11:37:56.335071+0000","last_fullsized":"2024-06-13T11:37:56.335071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:32:34.940913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332760+0000","last_change":"2024-06-13T11:37:56.329293+0000","last_active":"2024-06-13T11:37:56.332760+0000","last_peered":"2024-06-13T11:37:56.332760+0000","last_clean":"2024-06-13T11:37:56.332760+0000","last_became_active":"2024-06-13T11:37:56.329023+0000","last_became_peered":"2024-06-13T11:37:56.329023+0000","last_unstale":"2024-06-13T11:37:56.332760+0000","last_undegraded":"2024-06-13T11:37:56.332760+0000","last_fullsized":"2024-06-13T11:37:56.332760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331363+0000","last_change":"2024-06-13T11:37:56.327065+0000","last_active":"2024-06-13T11:37:56.331363+0000","last_peered":"2024-06-13T11:37:56.331363+0000","last_clean":"2024-06-13T11:37:56.331363+0000","last_became_active":"2024-06-13T11:37:56.326677+0000","last_became_peered":"2024-06-13T11:37:56.326677+0000","last_unstale":"2024-06-13T11:37:56.331363+0000","last_undegraded":"2024-06-13T11:37:56.331363+0000","last_fullsized":"2024-06-13T11:37:56.331363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:53.607284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336028+0000","last_change":"2024-06-13T11:37:56.333377+0000","last_active":"2024-06-13T11:37:56.336028+0000","last_peered":"2024-06-13T11:37:56.336028+0000","last_clean":"2024-06-13T11:37:56.336028+0000","last_became_active":"2024-06-13T11:37:56.333061+0000","last_became_peered":"2024-06-13T11:37:56.333061+0000","last_unstale":"2024-06-13T11:37:56.336028+0000","last_undegraded":"2024-06-13T11:37:56.336028+0000","last_fullsized":"2024-06-13T11:37:56.336028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322572+0000","last_change":"2024-06-13T11:37:56.320422+0000","last_active":"2024-06-13T11:37:56.322572+0000","last_peered":"2024-06-13T11:37:56.322572+0000","last_clean":"2024-06-13T11:37:56.322572+0000","last_became_active":"2024-06-13T11:37:56.319882+0000","last_became_peered":"2024-06-13T11:37:56.319882+0000","last_unstale":"2024-06-13T11:37:56.322572+0000","last_undegraded":"2024-06-13T11:37:56.322572+0000","last_fullsized":"2024-06-13T11:37:56.322572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:57:21.388732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338304+0000","last_change":"2024-06-13T11:37:56.337108+0000","last_active":"2024-06-13T11:37:56.338304+0000","last_peered":"2024-06-13T11:37:56.338304+0000","last_clean":"2024-06-13T11:37:56.338304+0000","last_became_active":"2024-06-13T11:37:56.336726+0000","last_became_peered":"2024-06-13T11:37:56.336726+0000","last_unstale":"2024-06-13T11:37:56.338304+0000","last_undegraded":"2024-06-13T11:37:56.338304+0000","last_fullsized":"2024-06-13T11:37:56.338304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338335+0000","last_change":"2024-06-13T11:37:56.336965+0000","last_active":"2024-06-13T11:37:56.338335+0000","last_peered":"2024-06-13T11:37:56.338335+0000","last_clean":"2024-06-13T11:37:56.338335+0000","last_became_active":"2024-06-13T11:37:56.336655+0000","last_became_peered":"2024-06-13T11:37:56.336655+0000","last_unstale":"2024-06-13T11:37:56.338335+0000","last_undegraded":"2024-06-13T11:37:56.338335+0000","last_fullsized":"2024-06-13T11:37:56.338335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319351+0000","last_change":"2024-06-13T11:37:56.328596+0000","last_active":"2024-06-13T11:37:57.319351+0000","last_peered":"2024-06-13T11:37:57.319351+0000","last_clean":"2024-06-13T11:37:57.319351+0000","last_became_active":"2024-06-13T11:37:56.328108+0000","last_became_peered":"2024-06-13T11:37:56.328108+0000","last_unstale":"2024-06-13T11:37:57.319351+0000","last_undegraded":"2024-06-13T11:37:57.319351+0000","last_fullsized":"2024-06-13T11:37:57.319351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:34.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322566+0000","last_change":"2024-06-13T11:37:56.317302+0000","last_active":"2024-06-13T11:37:56.322566+0000","last_peered":"2024-06-13T11:37:56.322566+0000","last_clean":"2024-06-13T11:37:56.322566+0000","last_became_active":"2024-06-13T11:37:56.316660+0000","last_became_peered":"2024-06-13T11:37:56.316660+0000","last_unstale":"2024-06-13T11:37:56.322566+0000","last_undegraded":"2024-06-13T11:37:56.322566+0000","last_fullsized":"2024-06-13T11:37:56.322566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:41:42.438398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319498+0000","last_change":"2024-06-13T11:37:56.327683+0000","last_active":"2024-06-13T11:37:57.319498+0000","last_peered":"2024-06-13T11:37:57.319498+0000","last_clean":"2024-06-13T11:37:57.319498+0000","last_became_active":"2024-06-13T11:37:56.327288+0000","last_became_peered":"2024-06-13T11:37:56.327288+0000","last_unstale":"2024-06-13T11:37:57.319498+0000","last_undegraded":"2024-06-13T11:37:57.319498+0000","last_fullsized":"2024-06-13T11:37:57.319498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322585+0000","last_change":"2024-06-13T11:37:56.320203+0000","last_active":"2024-06-13T11:37:56.322585+0000","last_peered":"2024-06-13T11:37:56.322585+0000","last_clean":"2024-06-13T11:37:56.322585+0000","last_became_active":"2024-06-13T11:37:56.319914+0000","last_became_peered":"2024-06-13T11:37:56.319914+0000","last_unstale":"2024-06-13T11:37:56.322585+0000","last_undegraded":"2024-06-13T11:37:56.322585+0000","last_fullsized":"2024-06-13T11:37:56.322585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:34.553237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331239+0000","last_change":"2024-06-13T11:37:56.328768+0000","last_active":"2024-06-13T11:37:56.331239+0000","last_peered":"2024-06-13T11:37:56.331239+0000","last_clean":"2024-06-13T11:37:56.331239+0000","last_became_active":"2024-06-13T11:37:56.328430+0000","last_became_peered":"2024-06-13T11:37:56.328430+0000","last_unstale":"2024-06-13T11:37:56.331239+0000","last_undegraded":"2024-06-13T11:37:56.331239+0000","last_fullsized":"2024-06-13T11:37:56.331239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336588+0000","last_change":"2024-06-13T11:37:56.333430+0000","last_active":"2024-06-13T11:37:56.336588+0000","last_peered":"2024-06-13T11:37:56.336588+0000","last_clean":"2024-06-13T11:37:56.336588+0000","last_became_active":"2024-06-13T11:37:56.333164+0000","last_became_peered":"2024-06-13T11:37:56.333164+0000","last_unstale":"2024-06-13T11:37:56.336588+0000","last_undegraded":"2024-06-13T11:37:56.336588+0000","last_fullsized":"2024-06-13T11:37:56.336588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:33.872712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328011+0000","last_change":"2024-06-13T11:37:56.326591+0000","last_active":"2024-06-13T11:37:56.328011+0000","last_peered":"2024-06-13T11:37:56.328011+0000","last_clean":"2024-06-13T11:37:56.328011+0000","last_became_active":"2024-06-13T11:37:56.326263+0000","last_became_peered":"2024-06-13T11:37:56.326263+0000","last_unstale":"2024-06-13T11:37:56.328011+0000","last_undegraded":"2024-06-13T11:37:56.328011+0000","last_fullsized":"2024-06-13T11:37:56.328011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:04:39.814324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320110+0000","last_change":"2024-06-13T11:37:56.327264+0000","last_active":"2024-06-13T11:37:57.320110+0000","last_peered":"2024-06-13T11:37:57.320110+0000","last_clean":"2024-06-13T11:37:57.320110+0000","last_became_active":"2024-06-13T11:37:56.326938+0000","last_became_peered":"2024-06-13T11:37:56.326938+0000","last_unstale":"2024-06-13T11:37:57.320110+0000","last_undegraded":"2024-06-13T11:37:57.320110+0000","last_fullsized":"2024-06-13T11:37:57.320110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.327272+0000","last_change":"2024-06-13T11:37:56.325540+0000","last_active":"2024-06-13T11:37:56.327272+0000","last_peered":"2024-06-13T11:37:56.327272+0000","last_clean":"2024-06-13T11:37:56.327272+0000","last_became_active":"2024-06-13T11:37:56.325219+0000","last_became_peered":"2024-06-13T11:37:56.325219+0000","last_unstale":"2024-06-13T11:37:56.327272+0000","last_undegraded":"2024-06-13T11:37:56.327272+0000","last_fullsized":"2024-06-13T11:37:56.327272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319823+0000","last_change":"2024-06-13T11:37:56.316438+0000","last_active":"2024-06-13T11:37:57.319823+0000","last_peered":"2024-06-13T11:37:57.319823+0000","last_clean":"2024-06-13T11:37:57.319823+0000","last_became_active":"2024-06-13T11:37:56.316174+0000","last_became_peered":"2024-06-13T11:37:56.316174+0000","last_unstale":"2024-06-13T11:37:57.319823+0000","last_undegraded":"2024-06-13T11:37:57.319823+0000","last_fullsized":"2024-06-13T11:37:57.319823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328276+0000","last_change":"2024-06-13T11:37:56.323559+0000","last_active":"2024-06-13T11:37:56.328276+0000","last_peered":"2024-06-13T11:37:56.328276+0000","last_clean":"2024-06-13T11:37:56.328276+0000","last_became_active":"2024-06-13T11:37:56.323291+0000","last_became_peered":"2024-06-13T11:37:56.323291+0000","last_unstale":"2024-06-13T11:37:56.328276+0000","last_undegraded":"2024-06-13T11:37:56.328276+0000","last_fullsized":"2024-06-13T11:37:56.328276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:38:46.544540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319362+0000","last_change":"2024-06-13T11:37:56.317261+0000","last_active":"2024-06-13T11:37:57.319362+0000","last_peered":"2024-06-13T11:37:57.319362+0000","last_clean":"2024-06-13T11:37:57.319362+0000","last_became_active":"2024-06-13T11:37:56.316998+0000","last_became_peered":"2024-06-13T11:37:56.316998+0000","last_unstale":"2024-06-13T11:37:57.319362+0000","last_undegraded":"2024-06-13T11:37:57.319362+0000","last_fullsized":"2024-06-13T11:37:57.319362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319351+0000","last_change":"2024-06-13T11:37:56.318813+0000","last_active":"2024-06-13T11:37:57.319351+0000","last_peered":"2024-06-13T11:37:57.319351+0000","last_clean":"2024-06-13T11:37:57.319351+0000","last_became_active":"2024-06-13T11:37:56.318534+0000","last_became_peered":"2024-06-13T11:37:56.318534+0000","last_unstale":"2024-06-13T11:37:57.319351+0000","last_undegraded":"2024-06-13T11:37:57.319351+0000","last_fullsized":"2024-06-13T11:37:57.319351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:20.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336610+0000","last_change":"2024-06-13T11:37:56.334243+0000","last_active":"2024-06-13T11:37:56.336610+0000","last_peered":"2024-06-13T11:37:56.336610+0000","last_clean":"2024-06-13T11:37:56.336610+0000","last_became_active":"2024-06-13T11:37:56.333952+0000","last_became_peered":"2024-06-13T11:37:56.333952+0000","last_unstale":"2024-06-13T11:37:56.336610+0000","last_undegraded":"2024-06-13T11:37:56.336610+0000","last_fullsized":"2024-06-13T11:37:56.336610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321475+0000","last_change":"2024-06-13T11:37:56.318049+0000","last_active":"2024-06-13T11:37:56.321475+0000","last_peered":"2024-06-13T11:37:56.321475+0000","last_clean":"2024-06-13T11:37:56.321475+0000","last_became_active":"2024-06-13T11:37:56.317769+0000","last_became_peered":"2024-06-13T11:37:56.317769+0000","last_unstale":"2024-06-13T11:37:56.321475+0000","last_undegraded":"2024-06-13T11:37:56.321475+0000","last_fullsized":"2024-06-13T11:37:56.321475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.338431+0000","last_change":"2024-06-13T11:37:56.336846+0000","last_active":"2024-06-13T11:37:56.338431+0000","last_peered":"2024-06-13T11:37:56.338431+0000","last_clean":"2024-06-13T11:37:56.338431+0000","last_became_active":"2024-06-13T11:37:56.336555+0000","last_became_peered":"2024-06-13T11:37:56.336555+0000","last_unstale":"2024-06-13T11:37:56.338431+0000","last_undegraded":"2024-06-13T11:37:56.338431+0000","last_fullsized":"2024-06-13T11:37:56.338431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320173+0000","last_change":"2024-06-13T11:37:55.305450+0000","last_active":"2024-06-13T11:37:57.320173+0000","last_peered":"2024-06-13T11:37:57.320173+0000","last_clean":"2024-06-13T11:37:57.320173+0000","last_became_active":"2024-06-13T11:37:55.305165+0000","last_became_peered":"2024-06-13T11:37:55.305165+0000","last_unstale":"2024-06-13T11:37:57.320173+0000","last_undegraded":"2024-06-13T11:37:57.320173+0000","last_fullsized":"2024-06-13T11:37:57.320173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:52.073467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332783+0000","last_change":"2024-06-13T11:37:56.330952+0000","last_active":"2024-06-13T11:37:56.332783+0000","last_peered":"2024-06-13T11:37:56.332783+0000","last_clean":"2024-06-13T11:37:56.332783+0000","last_became_active":"2024-06-13T11:37:56.330604+0000","last_became_peered":"2024-06-13T11:37:56.330604+0000","last_unstale":"2024-06-13T11:37:56.332783+0000","last_undegraded":"2024-06-13T11:37:56.332783+0000","last_fullsized":"2024-06-13T11:37:56.332783+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:22.766276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337848+0000","last_change":"2024-06-13T11:37:55.319411+0000","last_active":"2024-06-13T11:37:56.337848+0000","last_peered":"2024-06-13T11:37:56.337848+0000","last_clean":"2024-06-13T11:37:56.337848+0000","last_became_active":"2024-06-13T11:37:55.318305+0000","last_became_peered":"2024-06-13T11:37:55.318305+0000","last_unstale":"2024-06-13T11:37:56.337848+0000","last_undegraded":"2024-06-13T11:37:56.337848+0000","last_fullsized":"2024-06-13T11:37:56.337848+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:15:12.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337375+0000","last_change":"2024-06-13T11:37:56.334255+0000","last_active":"2024-06-13T11:37:56.337375+0000","last_peered":"2024-06-13T11:37:56.337375+0000","last_clean":"2024-06-13T11:37:56.337375+0000","last_became_active":"2024-06-13T11:37:56.333761+0000","last_became_peered":"2024-06-13T11:37:56.333761+0000","last_unstale":"2024-06-13T11:37:56.337375+0000","last_undegraded":"2024-06-13T11:37:56.337375+0000","last_fullsized":"2024-06-13T11:37:56.337375+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324180+0000","last_change":"2024-06-13T11:37:55.318481+0000","last_active":"2024-06-13T11:37:56.324180+0000","last_peered":"2024-06-13T11:37:56.324180+0000","last_clean":"2024-06-13T11:37:56.324180+0000","last_became_active":"2024-06-13T11:37:55.318164+0000","last_became_peered":"2024-06-13T11:37:55.318164+0000","last_unstale":"2024-06-13T11:37:56.324180+0000","last_undegraded":"2024-06-13T11:37:56.324180+0000","last_fullsized":"2024-06-13T11:37:56.324180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:33.823945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319390+0000","last_change":"2024-06-13T11:37:56.318534+0000","last_active":"2024-06-13T11:37:56.319390+0000","last_peered":"2024-06-13T11:37:56.319390+0000","last_clean":"2024-06-13T11:37:56.319390+0000","last_became_active":"2024-06-13T11:37:56.318248+0000","last_became_peered":"2024-06-13T11:37:56.318248+0000","last_unstale":"2024-06-13T11:37:56.319390+0000","last_undegraded":"2024-06-13T11:37:56.319390+0000","last_fullsized":"2024-06-13T11:37:56.319390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:24.453927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335250+0000","last_change":"2024-06-13T11:37:55.308705+0000","last_active":"2024-06-13T11:37:56.335250+0000","last_peered":"2024-06-13T11:37:56.335250+0000","last_clean":"2024-06-13T11:37:56.335250+0000","last_became_active":"2024-06-13T11:37:55.308399+0000","last_became_peered":"2024-06-13T11:37:55.308399+0000","last_unstale":"2024-06-13T11:37:56.335250+0000","last_undegraded":"2024-06-13T11:37:56.335250+0000","last_fullsized":"2024-06-13T11:37:56.335250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326916+0000","last_change":"2024-06-13T11:37:56.325979+0000","last_active":"2024-06-13T11:37:56.326916+0000","last_peered":"2024-06-13T11:37:56.326916+0000","last_clean":"2024-06-13T11:37:56.326916+0000","last_became_active":"2024-06-13T11:37:56.325682+0000","last_became_peered":"2024-06-13T11:37:56.325682+0000","last_unstale":"2024-06-13T11:37:56.326916+0000","last_undegraded":"2024-06-13T11:37:56.326916+0000","last_fullsized":"2024-06-13T11:37:56.326916+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:34.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326923+0000","last_change":"2024-06-13T11:37:55.314283+0000","last_active":"2024-06-13T11:37:56.326923+0000","last_peered":"2024-06-13T11:37:56.326923+0000","last_clean":"2024-06-13T11:37:56.326923+0000","last_became_active":"2024-06-13T11:37:55.313981+0000","last_became_peered":"2024-06-13T11:37:55.313981+0000","last_unstale":"2024-06-13T11:37:56.326923+0000","last_undegraded":"2024-06-13T11:37:56.326923+0000","last_fullsized":"2024-06-13T11:37:56.326923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:32.867795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322553+0000","last_change":"2024-06-13T11:37:56.320173+0000","last_active":"2024-06-13T11:37:56.322553+0000","last_peered":"2024-06-13T11:37:56.322553+0000","last_clean":"2024-06-13T11:37:56.322553+0000","last_became_active":"2024-06-13T11:37:56.319550+0000","last_became_peered":"2024-06-13T11:37:56.319550+0000","last_unstale":"2024-06-13T11:37:56.322553+0000","last_undegraded":"2024-06-13T11:37:56.322553+0000","last_fullsized":"2024-06-13T11:37:56.322553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.337594+0000","last_change":"2024-06-13T11:37:55.319302+0000","last_active":"2024-06-13T11:37:56.337594+0000","last_peered":"2024-06-13T11:37:56.337594+0000","last_clean":"2024-06-13T11:37:56.337594+0000","last_became_active":"2024-06-13T11:37:55.318884+0000","last_became_peered":"2024-06-13T11:37:55.318884+0000","last_unstale":"2024-06-13T11:37:56.337594+0000","last_undegraded":"2024-06-13T11:37:56.337594+0000","last_fullsized":"2024-06-13T11:37:56.337594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328993+0000","last_change":"2024-06-13T11:37:56.325772+0000","last_active":"2024-06-13T11:37:56.328993+0000","last_peered":"2024-06-13T11:37:56.328993+0000","last_clean":"2024-06-13T11:37:56.328993+0000","last_became_active":"2024-06-13T11:37:56.325245+0000","last_became_peered":"2024-06-13T11:37:56.325245+0000","last_unstale":"2024-06-13T11:37:56.328993+0000","last_undegraded":"2024-06-13T11:37:56.328993+0000","last_fullsized":"2024-06-13T11:37:56.328993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313464+0000","last_change":"2024-06-13T11:37:55.312037+0000","last_active":"2024-06-13T11:37:56.313464+0000","last_peered":"2024-06-13T11:37:56.313464+0000","last_clean":"2024-06-13T11:37:56.313464+0000","last_became_active":"2024-06-13T11:37:55.311676+0000","last_became_peered":"2024-06-13T11:37:55.311676+0000","last_unstale":"2024-06-13T11:37:56.313464+0000","last_undegraded":"2024-06-13T11:37:56.313464+0000","last_fullsized":"2024-06-13T11:37:56.313464+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333571+0000","last_change":"2024-06-13T11:37:56.331802+0000","last_active":"2024-06-13T11:37:56.333571+0000","last_peered":"2024-06-13T11:37:56.333571+0000","last_clean":"2024-06-13T11:37:56.333571+0000","last_became_active":"2024-06-13T11:37:56.331443+0000","last_became_peered":"2024-06-13T11:37:56.331443+0000","last_unstale":"2024-06-13T11:37:56.333571+0000","last_undegraded":"2024-06-13T11:37:56.333571+0000","last_fullsized":"2024-06-13T11:37:56.333571+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:22.710612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314234+0000","last_change":"2024-06-13T11:37:55.309937+0000","last_active":"2024-06-13T11:37:56.314234+0000","last_peered":"2024-06-13T11:37:56.314234+0000","last_clean":"2024-06-13T11:37:56.314234+0000","last_became_active":"2024-06-13T11:37:55.309677+0000","last_became_peered":"2024-06-13T11:37:55.309677+0000","last_unstale":"2024-06-13T11:37:56.314234+0000","last_undegraded":"2024-06-13T11:37:56.314234+0000","last_fullsized":"2024-06-13T11:37:56.314234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:06:17.518923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333134+0000","last_change":"2024-06-13T11:37:56.328114+0000","last_active":"2024-06-13T11:37:56.333134+0000","last_peered":"2024-06-13T11:37:56.333134+0000","last_clean":"2024-06-13T11:37:56.333134+0000","last_became_active":"2024-06-13T11:37:56.327404+0000","last_became_peered":"2024-06-13T11:37:56.327404+0000","last_unstale":"2024-06-13T11:37:56.333134+0000","last_undegraded":"2024-06-13T11:37:56.333134+0000","last_fullsized":"2024-06-13T11:37:56.333134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:47.251555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.311070+0000","last_change":"2024-06-13T11:37:55.317546+0000","last_active":"2024-06-13T11:37:56.311070+0000","last_peered":"2024-06-13T11:37:56.311070+0000","last_clean":"2024-06-13T11:37:56.311070+0000","last_became_active":"2024-06-13T11:37:55.317278+0000","last_became_peered":"2024-06-13T11:37:55.317278+0000","last_unstale":"2024-06-13T11:37:56.311070+0000","last_undegraded":"2024-06-13T11:37:56.311070+0000","last_fullsized":"2024-06-13T11:37:56.311070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:57.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336574+0000","last_change":"2024-06-13T11:37:56.333326+0000","last_active":"2024-06-13T11:37:56.336574+0000","last_peered":"2024-06-13T11:37:56.336574+0000","last_clean":"2024-06-13T11:37:56.336574+0000","last_became_active":"2024-06-13T11:37:56.332950+0000","last_became_peered":"2024-06-13T11:37:56.332950+0000","last_unstale":"2024-06-13T11:37:56.336574+0000","last_undegraded":"2024-06-13T11:37:56.336574+0000","last_fullsized":"2024-06-13T11:37:56.336574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.309602+0000","last_change":"2024-06-13T11:37:55.313056+0000","last_active":"2024-06-13T11:37:56.309602+0000","last_peered":"2024-06-13T11:37:56.309602+0000","last_clean":"2024-06-13T11:37:56.309602+0000","last_became_active":"2024-06-13T11:37:55.312782+0000","last_became_peered":"2024-06-13T11:37:55.312782+0000","last_unstale":"2024-06-13T11:37:56.309602+0000","last_undegraded":"2024-06-13T11:37:56.309602+0000","last_fullsized":"2024-06-13T11:37:56.309602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:06.789673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336735+0000","last_change":"2024-06-13T11:37:56.335836+0000","last_active":"2024-06-13T11:37:56.336735+0000","last_peered":"2024-06-13T11:37:56.336735+0000","last_clean":"2024-06-13T11:37:56.336735+0000","last_became_active":"2024-06-13T11:37:56.335541+0000","last_became_peered":"2024-06-13T11:37:56.335541+0000","last_unstale":"2024-06-13T11:37:56.336735+0000","last_undegraded":"2024-06-13T11:37:56.336735+0000","last_fullsized":"2024-06-13T11:37:56.336735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335147+0000","last_change":"2024-06-13T11:37:55.312146+0000","last_active":"2024-06-13T11:37:56.335147+0000","last_peered":"2024-06-13T11:37:56.335147+0000","last_clean":"2024-06-13T11:37:56.335147+0000","last_became_active":"2024-06-13T11:37:55.311692+0000","last_became_peered":"2024-06-13T11:37:55.311692+0000","last_unstale":"2024-06-13T11:37:56.335147+0000","last_undegraded":"2024-06-13T11:37:56.335147+0000","last_fullsized":"2024-06-13T11:37:56.335147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:52.165608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.331247+0000","last_change":"2024-06-13T11:37:56.328733+0000","last_active":"2024-06-13T11:37:56.331247+0000","last_peered":"2024-06-13T11:37:56.331247+0000","last_clean":"2024-06-13T11:37:56.331247+0000","last_became_active":"2024-06-13T11:37:56.328353+0000","last_became_peered":"2024-06-13T11:37:56.328353+0000","last_unstale":"2024-06-13T11:37:56.331247+0000","last_undegraded":"2024-06-13T11:37:56.331247+0000","last_fullsized":"2024-06-13T11:37:56.331247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339092+0000","last_change":"2024-06-13T11:37:55.309442+0000","last_active":"2024-06-13T11:37:56.339092+0000","last_peered":"2024-06-13T11:37:56.339092+0000","last_clean":"2024-06-13T11:37:56.339092+0000","last_became_active":"2024-06-13T11:37:55.309109+0000","last_became_peered":"2024-06-13T11:37:55.309109+0000","last_unstale":"2024-06-13T11:37:56.339092+0000","last_undegraded":"2024-06-13T11:37:56.339092+0000","last_fullsized":"2024-06-13T11:37:56.339092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:55.069527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.326115+0000","last_change":"2024-06-13T11:37:56.323618+0000","last_active":"2024-06-13T11:37:56.326115+0000","last_peered":"2024-06-13T11:37:56.326115+0000","last_clean":"2024-06-13T11:37:56.326115+0000","last_became_active":"2024-06-13T11:37:56.323333+0000","last_became_peered":"2024-06-13T11:37:56.323333+0000","last_unstale":"2024-06-13T11:37:56.326115+0000","last_undegraded":"2024-06-13T11:37:56.326115+0000","last_fullsized":"2024-06-13T11:37:56.326115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:39.954448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333494+0000","last_change":"2024-06-13T11:37:55.316960+0000","last_active":"2024-06-13T11:37:56.333494+0000","last_peered":"2024-06-13T11:37:56.333494+0000","last_clean":"2024-06-13T11:37:56.333494+0000","last_became_active":"2024-06-13T11:37:55.316663+0000","last_became_peered":"2024-06-13T11:37:55.316663+0000","last_unstale":"2024-06-13T11:37:56.333494+0000","last_undegraded":"2024-06-13T11:37:56.333494+0000","last_fullsized":"2024-06-13T11:37:56.333494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:06.986712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334322+0000","last_change":"2024-06-13T11:37:56.327997+0000","last_active":"2024-06-13T11:37:56.334322+0000","last_peered":"2024-06-13T11:37:56.334322+0000","last_clean":"2024-06-13T11:37:56.334322+0000","last_became_active":"2024-06-13T11:37:56.327722+0000","last_became_peered":"2024-06-13T11:37:56.327722+0000","last_unstale":"2024-06-13T11:37:56.334322+0000","last_undegraded":"2024-06-13T11:37:56.334322+0000","last_fullsized":"2024-06-13T11:37:56.334322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:58:30.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313590+0000","last_change":"2024-06-13T11:37:55.310340+0000","last_active":"2024-06-13T11:37:56.313590+0000","last_peered":"2024-06-13T11:37:56.313590+0000","last_clean":"2024-06-13T11:37:56.313590+0000","last_became_active":"2024-06-13T11:37:55.310063+0000","last_became_peered":"2024-06-13T11:37:55.310063+0000","last_unstale":"2024-06-13T11:37:56.313590+0000","last_undegraded":"2024-06-13T11:37:56.313590+0000","last_fullsized":"2024-06-13T11:37:56.313590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:38.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336464+0000","last_change":"2024-06-13T11:37:56.333319+0000","last_active":"2024-06-13T11:37:56.336464+0000","last_peered":"2024-06-13T11:37:56.336464+0000","last_clean":"2024-06-13T11:37:56.336464+0000","last_became_active":"2024-06-13T11:37:56.333028+0000","last_became_peered":"2024-06-13T11:37:56.333028+0000","last_unstale":"2024-06-13T11:37:56.336464+0000","last_undegraded":"2024-06-13T11:37:56.336464+0000","last_fullsized":"2024-06-13T11:37:56.336464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:27.193373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319065+0000","last_change":"2024-06-13T11:37:55.305492+0000","last_active":"2024-06-13T11:37:57.319065+0000","last_peered":"2024-06-13T11:37:57.319065+0000","last_clean":"2024-06-13T11:37:57.319065+0000","last_became_active":"2024-06-13T11:37:55.305173+0000","last_became_peered":"2024-06-13T11:37:55.305173+0000","last_unstale":"2024-06-13T11:37:57.319065+0000","last_undegraded":"2024-06-13T11:37:57.319065+0000","last_fullsized":"2024-06-13T11:37:57.319065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:29:34.230576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333552+0000","last_change":"2024-06-13T11:37:56.330323+0000","last_active":"2024-06-13T11:37:56.333552+0000","last_peered":"2024-06-13T11:37:56.333552+0000","last_clean":"2024-06-13T11:37:56.333552+0000","last_became_active":"2024-06-13T11:37:56.330008+0000","last_became_peered":"2024-06-13T11:37:56.330008+0000","last_unstale":"2024-06-13T11:37:56.333552+0000","last_undegraded":"2024-06-13T11:37:56.333552+0000","last_fullsized":"2024-06-13T11:37:56.333552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:41:16.066555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.339466+0000","last_change":"2024-06-13T11:37:55.317870+0000","last_active":"2024-06-13T11:37:56.339466+0000","last_peered":"2024-06-13T11:37:56.339466+0000","last_clean":"2024-06-13T11:37:56.339466+0000","last_became_active":"2024-06-13T11:37:55.317569+0000","last_became_peered":"2024-06-13T11:37:55.317569+0000","last_unstale":"2024-06-13T11:37:56.339466+0000","last_undegraded":"2024-06-13T11:37:56.339466+0000","last_fullsized":"2024-06-13T11:37:56.339466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320986+0000","last_change":"2024-06-13T11:37:56.318768+0000","last_active":"2024-06-13T11:37:56.320986+0000","last_peered":"2024-06-13T11:37:56.320986+0000","last_clean":"2024-06-13T11:37:56.320986+0000","last_became_active":"2024-06-13T11:37:56.318414+0000","last_became_peered":"2024-06-13T11:37:56.318414+0000","last_unstale":"2024-06-13T11:37:56.320986+0000","last_undegraded":"2024-06-13T11:37:56.320986+0000","last_fullsized":"2024-06-13T11:37:56.320986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:43.606286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.325219+0000","last_change":"2024-06-13T11:37:55.314832+0000","last_active":"2024-06-13T11:37:56.325219+0000","last_peered":"2024-06-13T11:37:56.325219+0000","last_clean":"2024-06-13T11:37:56.325219+0000","last_became_active":"2024-06-13T11:37:55.314553+0000","last_became_peered":"2024-06-13T11:37:55.314553+0000","last_unstale":"2024-06-13T11:37:56.325219+0000","last_undegraded":"2024-06-13T11:37:56.325219+0000","last_fullsized":"2024-06-13T11:37:56.325219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:33.732710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335202+0000","last_change":"2024-06-13T11:37:56.329960+0000","last_active":"2024-06-13T11:37:56.335202+0000","last_peered":"2024-06-13T11:37:56.335202+0000","last_clean":"2024-06-13T11:37:56.335202+0000","last_became_active":"2024-06-13T11:37:56.327480+0000","last_became_peered":"2024-06-13T11:37:56.327480+0000","last_unstale":"2024-06-13T11:37:56.335202+0000","last_undegraded":"2024-06-13T11:37:56.335202+0000","last_fullsized":"2024-06-13T11:37:56.335202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:45.975185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332385+0000","last_change":"2024-06-13T11:37:55.310530+0000","last_active":"2024-06-13T11:37:56.332385+0000","last_peered":"2024-06-13T11:37:56.332385+0000","last_clean":"2024-06-13T11:37:56.332385+0000","last_became_active":"2024-06-13T11:37:55.310267+0000","last_became_peered":"2024-06-13T11:37:55.310267+0000","last_unstale":"2024-06-13T11:37:56.332385+0000","last_undegraded":"2024-06-13T11:37:56.332385+0000","last_fullsized":"2024-06-13T11:37:56.332385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.333960+0000","last_change":"2024-06-13T11:37:56.330670+0000","last_active":"2024-06-13T11:37:56.333960+0000","last_peered":"2024-06-13T11:37:56.333960+0000","last_clean":"2024-06-13T11:37:56.333960+0000","last_became_active":"2024-06-13T11:37:56.330391+0000","last_became_peered":"2024-06-13T11:37:56.330391+0000","last_unstale":"2024-06-13T11:37:56.333960+0000","last_undegraded":"2024-06-13T11:37:56.333960+0000","last_fullsized":"2024-06-13T11:37:56.333960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:07.794590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334822+0000","last_change":"2024-06-13T11:37:55.315973+0000","last_active":"2024-06-13T11:37:56.334822+0000","last_peered":"2024-06-13T11:37:56.334822+0000","last_clean":"2024-06-13T11:37:56.334822+0000","last_became_active":"2024-06-13T11:37:55.315613+0000","last_became_peered":"2024-06-13T11:37:55.315613+0000","last_unstale":"2024-06-13T11:37:56.334822+0000","last_undegraded":"2024-06-13T11:37:56.334822+0000","last_fullsized":"2024-06-13T11:37:56.334822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:39:13.330192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322587+0000","last_change":"2024-06-13T11:37:56.317844+0000","last_active":"2024-06-13T11:37:56.322587+0000","last_peered":"2024-06-13T11:37:56.322587+0000","last_clean":"2024-06-13T11:37:56.322587+0000","last_became_active":"2024-06-13T11:37:56.317533+0000","last_became_peered":"2024-06-13T11:37:56.317533+0000","last_unstale":"2024-06-13T11:37:56.322587+0000","last_undegraded":"2024-06-13T11:37:56.322587+0000","last_fullsized":"2024-06-13T11:37:56.322587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:49:20.305235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.313660+0000","last_change":"2024-06-13T11:37:55.317261+0000","last_active":"2024-06-13T11:37:56.313660+0000","last_peered":"2024-06-13T11:37:56.313660+0000","last_clean":"2024-06-13T11:37:56.313660+0000","last_became_active":"2024-06-13T11:37:55.316983+0000","last_became_peered":"2024-06-13T11:37:55.316983+0000","last_unstale":"2024-06-13T11:37:56.313660+0000","last_undegraded":"2024-06-13T11:37:56.313660+0000","last_fullsized":"2024-06-13T11:37:56.313660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:19.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336402+0000","last_change":"2024-06-13T11:37:56.332777+0000","last_active":"2024-06-13T11:37:56.336402+0000","last_peered":"2024-06-13T11:37:56.336402+0000","last_clean":"2024-06-13T11:37:56.336402+0000","last_became_active":"2024-06-13T11:37:56.332287+0000","last_became_peered":"2024-06-13T11:37:56.332287+0000","last_unstale":"2024-06-13T11:37:56.336402+0000","last_undegraded":"2024-06-13T11:37:56.336402+0000","last_fullsized":"2024-06-13T11:37:56.336402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:18:26.967477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.335535+0000","last_change":"2024-06-13T11:37:55.318031+0000","last_active":"2024-06-13T11:37:56.335535+0000","last_peered":"2024-06-13T11:37:56.335535+0000","last_clean":"2024-06-13T11:37:56.335535+0000","last_became_active":"2024-06-13T11:37:55.316716+0000","last_became_peered":"2024-06-13T11:37:55.316716+0000","last_unstale":"2024-06-13T11:37:56.335535+0000","last_undegraded":"2024-06-13T11:37:56.335535+0000","last_fullsized":"2024-06-13T11:37:56.335535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:54:29.089099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336951+0000","last_change":"2024-06-13T11:37:56.336329+0000","last_active":"2024-06-13T11:37:56.336951+0000","last_peered":"2024-06-13T11:37:56.336951+0000","last_clean":"2024-06-13T11:37:56.336951+0000","last_became_active":"2024-06-13T11:37:56.335972+0000","last_became_peered":"2024-06-13T11:37:56.335972+0000","last_unstale":"2024-06-13T11:37:56.336951+0000","last_undegraded":"2024-06-13T11:37:56.336951+0000","last_fullsized":"2024-06-13T11:37:56.336951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306671+0000","last_change":"2024-06-13T11:37:55.312486+0000","last_active":"2024-06-13T11:37:56.306671+0000","last_peered":"2024-06-13T11:37:56.306671+0000","last_clean":"2024-06-13T11:37:56.306671+0000","last_became_active":"2024-06-13T11:37:55.312206+0000","last_became_peered":"2024-06-13T11:37:55.312206+0000","last_unstale":"2024-06-13T11:37:56.306671+0000","last_undegraded":"2024-06-13T11:37:56.306671+0000","last_fullsized":"2024-06-13T11:37:56.306671+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:14:01.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315037+0000","last_change":"2024-06-13T11:37:56.313649+0000","last_active":"2024-06-13T11:37:56.315037+0000","last_peered":"2024-06-13T11:37:56.315037+0000","last_clean":"2024-06-13T11:37:56.315037+0000","last_became_active":"2024-06-13T11:37:56.313376+0000","last_became_peered":"2024-06-13T11:37:56.313376+0000","last_unstale":"2024-06-13T11:37:56.315037+0000","last_undegraded":"2024-06-13T11:37:56.315037+0000","last_fullsized":"2024-06-13T11:37:56.315037+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320310+0000","last_change":"2024-06-13T11:37:55.315779+0000","last_active":"2024-06-13T11:37:56.320310+0000","last_peered":"2024-06-13T11:37:56.320310+0000","last_clean":"2024-06-13T11:37:56.320310+0000","last_became_active":"2024-06-13T11:37:55.315487+0000","last_became_peered":"2024-06-13T11:37:55.315487+0000","last_unstale":"2024-06-13T11:37:56.320310+0000","last_undegraded":"2024-06-13T11:37:56.320310+0000","last_fullsized":"2024-06-13T11:37:56.320310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.334552+0000","last_change":"2024-06-13T11:37:56.332594+0000","last_active":"2024-06-13T11:37:56.334552+0000","last_peered":"2024-06-13T11:37:56.334552+0000","last_clean":"2024-06-13T11:37:56.334552+0000","last_became_active":"2024-06-13T11:37:56.332265+0000","last_became_peered":"2024-06-13T11:37:56.332265+0000","last_unstale":"2024-06-13T11:37:56.334552+0000","last_undegraded":"2024-06-13T11:37:56.334552+0000","last_fullsized":"2024-06-13T11:37:56.334552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:04:56.197473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306156+0000","last_change":"2024-06-13T11:37:55.314354+0000","last_active":"2024-06-13T11:37:56.306156+0000","last_peered":"2024-06-13T11:37:56.306156+0000","last_clean":"2024-06-13T11:37:56.306156+0000","last_became_active":"2024-06-13T11:37:55.314034+0000","last_became_peered":"2024-06-13T11:37:55.314034+0000","last_unstale":"2024-06-13T11:37:56.306156+0000","last_undegraded":"2024-06-13T11:37:56.306156+0000","last_fullsized":"2024-06-13T11:37:56.306156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:29.902564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.321709+0000","last_change":"2024-06-13T11:37:56.318282+0000","last_active":"2024-06-13T11:37:56.321709+0000","last_peered":"2024-06-13T11:37:56.321709+0000","last_clean":"2024-06-13T11:37:56.321709+0000","last_became_active":"2024-06-13T11:37:56.317985+0000","last_became_peered":"2024-06-13T11:37:56.317985+0000","last_unstale":"2024-06-13T11:37:56.321709+0000","last_undegraded":"2024-06-13T11:37:56.321709+0000","last_fullsized":"2024-06-13T11:37:56.321709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.323334+0000","last_change":"2024-06-13T11:37:55.313951+0000","last_active":"2024-06-13T11:37:56.323334+0000","last_peered":"2024-06-13T11:37:56.323334+0000","last_clean":"2024-06-13T11:37:56.323334+0000","last_became_active":"2024-06-13T11:37:55.313509+0000","last_became_peered":"2024-06-13T11:37:55.313509+0000","last_unstale":"2024-06-13T11:37:56.323334+0000","last_undegraded":"2024-06-13T11:37:56.323334+0000","last_fullsized":"2024-06-13T11:37:56.323334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:26.188457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336553+0000","last_change":"2024-06-13T11:37:56.333448+0000","last_active":"2024-06-13T11:37:56.336553+0000","last_peered":"2024-06-13T11:37:56.336553+0000","last_clean":"2024-06-13T11:37:56.336553+0000","last_became_active":"2024-06-13T11:37:56.332703+0000","last_became_peered":"2024-06-13T11:37:56.332703+0000","last_unstale":"2024-06-13T11:37:56.336553+0000","last_undegraded":"2024-06-13T11:37:56.336553+0000","last_fullsized":"2024-06-13T11:37:56.336553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:34.737626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.306065+0000","last_change":"2024-06-13T11:37:55.310716+0000","last_active":"2024-06-13T11:37:56.306065+0000","last_peered":"2024-06-13T11:37:56.306065+0000","last_clean":"2024-06-13T11:37:56.306065+0000","last_became_active":"2024-06-13T11:37:55.310423+0000","last_became_peered":"2024-06-13T11:37:55.310423+0000","last_unstale":"2024-06-13T11:37:56.306065+0000","last_undegraded":"2024-06-13T11:37:56.306065+0000","last_fullsized":"2024-06-13T11:37:56.306065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:17:20.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.324450+0000","last_change":"2024-06-13T11:37:56.323367+0000","last_active":"2024-06-13T11:37:56.324450+0000","last_peered":"2024-06-13T11:37:56.324450+0000","last_clean":"2024-06-13T11:37:56.324450+0000","last_became_active":"2024-06-13T11:37:56.323061+0000","last_became_peered":"2024-06-13T11:37:56.323061+0000","last_unstale":"2024-06-13T11:37:56.324450+0000","last_undegraded":"2024-06-13T11:37:56.324450+0000","last_fullsized":"2024-06-13T11:37:56.324450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:14:31.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315192+0000","last_change":"2024-06-13T11:37:55.316693+0000","last_active":"2024-06-13T11:37:56.315192+0000","last_peered":"2024-06-13T11:37:56.315192+0000","last_clean":"2024-06-13T11:37:56.315192+0000","last_became_active":"2024-06-13T11:37:55.316352+0000","last_became_peered":"2024-06-13T11:37:55.316352+0000","last_unstale":"2024-06-13T11:37:56.315192+0000","last_undegraded":"2024-06-13T11:37:56.315192+0000","last_fullsized":"2024-06-13T11:37:56.315192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.332807+0000","last_change":"2024-06-13T11:37:56.330835+0000","last_active":"2024-06-13T11:37:56.332807+0000","last_peered":"2024-06-13T11:37:56.332807+0000","last_clean":"2024-06-13T11:37:56.332807+0000","last_became_active":"2024-06-13T11:37:56.330558+0000","last_became_peered":"2024-06-13T11:37:56.330558+0000","last_unstale":"2024-06-13T11:37:56.332807+0000","last_undegraded":"2024-06-13T11:37:56.332807+0000","last_fullsized":"2024-06-13T11:37:56.332807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.314791+0000","last_change":"2024-06-13T11:37:55.317955+0000","last_active":"2024-06-13T11:37:56.314791+0000","last_peered":"2024-06-13T11:37:56.314791+0000","last_clean":"2024-06-13T11:37:56.314791+0000","last_became_active":"2024-06-13T11:37:55.317670+0000","last_became_peered":"2024-06-13T11:37:55.317670+0000","last_unstale":"2024-06-13T11:37:56.314791+0000","last_undegraded":"2024-06-13T11:37:56.314791+0000","last_fullsized":"2024-06-13T11:37:56.314791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:49.054318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328843+0000","last_change":"2024-06-13T11:37:56.327970+0000","last_active":"2024-06-13T11:37:56.328843+0000","last_peered":"2024-06-13T11:37:56.328843+0000","last_clean":"2024-06-13T11:37:56.328843+0000","last_became_active":"2024-06-13T11:37:56.327680+0000","last_became_peered":"2024-06-13T11:37:56.327680+0000","last_unstale":"2024-06-13T11:37:56.328843+0000","last_undegraded":"2024-06-13T11:37:56.328843+0000","last_fullsized":"2024-06-13T11:37:56.328843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:07.991629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319495+0000","last_change":"2024-06-13T11:37:55.316251+0000","last_active":"2024-06-13T11:37:57.319495+0000","last_peered":"2024-06-13T11:37:57.319495+0000","last_clean":"2024-06-13T11:37:57.319495+0000","last_became_active":"2024-06-13T11:37:55.315016+0000","last_became_peered":"2024-06-13T11:37:55.315016+0000","last_unstale":"2024-06-13T11:37:57.319495+0000","last_undegraded":"2024-06-13T11:37:57.319495+0000","last_fullsized":"2024-06-13T11:37:57.319495+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:33.662473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.328974+0000","last_change":"2024-06-13T11:37:56.325514+0000","last_active":"2024-06-13T11:37:56.328974+0000","last_peered":"2024-06-13T11:37:56.328974+0000","last_clean":"2024-06-13T11:37:56.328974+0000","last_became_active":"2024-06-13T11:37:56.324920+0000","last_became_peered":"2024-06-13T11:37:56.324920+0000","last_unstale":"2024-06-13T11:37:56.328974+0000","last_undegraded":"2024-06-13T11:37:56.328974+0000","last_fullsized":"2024-06-13T11:37:56.328974+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:22.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.315670+0000","last_change":"2024-06-13T11:37:55.308637+0000","last_active":"2024-06-13T11:37:56.315670+0000","last_peered":"2024-06-13T11:37:56.315670+0000","last_clean":"2024-06-13T11:37:56.315670+0000","last_became_active":"2024-06-13T11:37:55.308361+0000","last_became_peered":"2024-06-13T11:37:55.308361+0000","last_unstale":"2024-06-13T11:37:56.315670+0000","last_undegraded":"2024-06-13T11:37:56.315670+0000","last_fullsized":"2024-06-13T11:37:56.315670+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.336100+0000","last_change":"2024-06-13T11:37:56.332842+0000","last_active":"2024-06-13T11:37:56.336100+0000","last_peered":"2024-06-13T11:37:56.336100+0000","last_clean":"2024-06-13T11:37:56.336100+0000","last_became_active":"2024-06-13T11:37:56.332557+0000","last_became_peered":"2024-06-13T11:37:56.332557+0000","last_unstale":"2024-06-13T11:37:56.336100+0000","last_undegraded":"2024-06-13T11:37:56.336100+0000","last_fullsized":"2024-06-13T11:37:56.336100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:53.170524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.310725+0000","last_change":"2024-06-13T11:37:55.315564+0000","last_active":"2024-06-13T11:37:56.310725+0000","last_peered":"2024-06-13T11:37:56.310725+0000","last_clean":"2024-06-13T11:37:56.310725+0000","last_became_active":"2024-06-13T11:37:55.313545+0000","last_became_peered":"2024-06-13T11:37:55.313545+0000","last_unstale":"2024-06-13T11:37:56.310725+0000","last_undegraded":"2024-06-13T11:37:56.310725+0000","last_fullsized":"2024-06-13T11:37:56.310725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:46.960127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.322853+0000","last_change":"2024-06-13T11:37:56.319494+0000","last_active":"2024-06-13T11:37:56.322853+0000","last_peered":"2024-06-13T11:37:56.322853+0000","last_clean":"2024-06-13T11:37:56.322853+0000","last_became_active":"2024-06-13T11:37:56.319182+0000","last_became_peered":"2024-06-13T11:37:56.319182+0000","last_unstale":"2024-06-13T11:37:56.322853+0000","last_undegraded":"2024-06-13T11:37:56.322853+0000","last_fullsized":"2024-06-13T11:37:56.322853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.320500+0000","last_change":"2024-06-13T11:37:55.318759+0000","last_active":"2024-06-13T11:37:56.320500+0000","last_peered":"2024-06-13T11:37:56.320500+0000","last_clean":"2024-06-13T11:37:56.320500+0000","last_became_active":"2024-06-13T11:37:55.318420+0000","last_became_peered":"2024-06-13T11:37:55.318420+0000","last_unstale":"2024-06-13T11:37:56.320500+0000","last_undegraded":"2024-06-13T11:37:56.320500+0000","last_fullsized":"2024-06-13T11:37:56.320500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:21.172360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-06-13T11:37:56.319200+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:56.319200+0000","last_peered":"2024-06-13T11:37:56.319200+0000","last_clean":"2024-06-13T11:37:56.319200+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:56.319200+0000","last_undegraded":"2024-06-13T11:37:56.319200+0000","last_fullsized":"2024-06-13T11:37:56.319200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":172124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":397312,"data_stored":164887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":179328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:38:04.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:38:04.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.918+0000 7fa19d79e640 1 Processor -- start 2024-06-13T11:38:04.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.918+0000 7fa19d79e640 1 -- start start 2024-06-13T11:38:04.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.918+0000 7fa19d79e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa198141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:04.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa19d79e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa198141750 0x7fa1981446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:04.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa19d79e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa198144bf0 con 0x7fa1980d3410 2024-06-13T11:38:04.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa19d79e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa1981630e0 con 0x7fa198141750 2024-06-13T11:38:04.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa19d79e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa1981624d0 con 0x7fa198141370 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa198141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa1967fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa198141750 0x7fa1981446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa198141c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3301/0 says I am v2:172.21.15.43:60484/0 (socket says 172.21.15.43:60484) 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 -- 172.21.15.43:0/771213920 learned_addr learned my addr 172.21.15.43:0/771213920 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 -- 172.21.15.43:0/771213920 >> v2:172.21.15.53:3300/0 conn(0x7fa198141750 msgr2=0x7fa1981446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 --2- 172.21.15.43:0/771213920 >> v2:172.21.15.53:3300/0 conn(0x7fa198141750 0x7fa1981446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 -- 172.21.15.43:0/771213920 >> v1:172.21.15.53:6789/0 conn(0x7fa1980d3410 legacy=0x7fa19815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa196ffd640 1 -- 172.21.15.43:0/771213920 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1981627b0 con 0x7fa198141370 2024-06-13T11:38:04.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.919+0000 7fa1967fc640 1 --2- 172.21.15.43:0/771213920 >> v2:172.21.15.53:3300/0 conn(0x7fa198141750 0x7fa1981446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:38:04.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.920+0000 7fa196ffd640 1 --2- 172.21.15.43:0/771213920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa198141c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e50 tx=0x7fa19002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b57c4e1911f0dda server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:04.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.920+0000 7fa195ffb640 1 -- 172.21.15.43:0/771213920 <== mon.2 v2:172.21.15.53:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190036070 con 0x7fa198141370 2024-06-13T11:38:04.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.920+0000 7fa195ffb640 1 -- 172.21.15.43:0/771213920 <== mon.2 v2:172.21.15.53:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa190031600 con 0x7fa198141370 2024-06-13T11:38:04.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.920+0000 7fa195ffb640 1 -- 172.21.15.43:0/771213920 <== mon.2 v2:172.21.15.53:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900319d0 con 0x7fa198141370 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 -- 172.21.15.43:0/771213920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 msgr2=0x7fa198141c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 --2- 172.21.15.43:0/771213920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa198141c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e50 tx=0x7fa19002a710 comp rx=0 tx=0).stop 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 -- 172.21.15.43:0/771213920 shutdown_connections 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 --2- 172.21.15.43:0/771213920 >> v2:172.21.15.53:3300/0 conn(0x7fa198141750 0x7fa1981446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 --2- 172.21.15.43:0/771213920 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa198141c40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 -- 172.21.15.43:0/771213920 >> 172.21.15.43:0/771213920 conn(0x7fa1980d1000 msgr2=0x7fa1980d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 -- 172.21.15.43:0/771213920 shutdown_connections 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.921+0000 7fa19d79e640 1 -- 172.21.15.43:0/771213920 wait complete. 2024-06-13T11:38:04.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 Processor -- start 2024-06-13T11:38:04.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 -- start start 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1980d3410 0x7fa1980b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa1980d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 0x7fa1980d1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa198162160 con 0x7fa1980b1920 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa198162d70 con 0x7fa1980d3410 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.923+0000 7fa19d79e640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7fa1980ae430 con 0x7fa198141370 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 0x7fa1980d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 0x7fa1980d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51074/0 (socket says 172.21.15.43:51074) 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 -- 172.21.15.43:0/3607827061 learned_addr learned my addr 172.21.15.43:0/3607827061 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:04.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa196ffd640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1980d3410 0x7fa1980b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1967fc640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa1980d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 -- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 msgr2=0x7fa1980d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa1980d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 -- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1980d3410 msgr2=0x7fa1980b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1980d3410 0x7fa1980b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 -- 172.21.15.43:0/3607827061 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1980b1e60 con 0x7fa1980b1920 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa1977fe640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 0x7fa1980d1920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa188001eb0 tx=0x7fa18800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188017070 con 0x7fa1980b1920 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1880052d0 con 0x7fa1980b1920 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1980b2140 con 0x7fa1980b1920 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188003810 con 0x7fa1980b1920 2024-06-13T11:38:04.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.924+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1980b2700 con 0x7fa1980b1920 2024-06-13T11:38:04.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.926+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19804ffb0 con 0x7fa1980b1920 2024-06-13T11:38:04.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.926+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa18801a070 con 0x7fa1980b1920 2024-06-13T11:38:04.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.927+0000 7fa18f7fe640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa17806be60 0x7fa17806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:04.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.927+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fa18808a300 con 0x7fa1980b1920 2024-06-13T11:38:04.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.927+0000 7fa196ffd640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa17806be60 0x7fa17806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:04.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.927+0000 7fa196ffd640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa17806be60 0x7fa17806e320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa190033000 tx=0x7fa190009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:04.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:04.931+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa1880584d0 con 0x7fa1980b1920 2024-06-13T11:38:05.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.114+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 --> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1980abae0 con 0x7fa17806be60 2024-06-13T11:38:05.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.120+0000 7fa18f7fe640 1 -- 172.21.15.43:0/3607827061 <== mgr.4102 v2:172.21.15.53:6832/3639668584 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251870 (secure 0 0 0) 0x7fa1980abae0 con 0x7fa17806be60 2024-06-13T11:38:05.122 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:05.123 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa17806be60 msgr2=0x7fa17806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa17806be60 0x7fa17806e320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa190033000 tx=0x7fa190009000 comp rx=0 tx=0).stop 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 msgr2=0x7fa1980d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 0x7fa1980d1920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa188001eb0 tx=0x7fa18800c890 comp rx=0 tx=0).stop 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 shutdown_connections 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7fa17806be60 0x7fa17806e320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1980b1920 0x7fa1980d1920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7fa198141370 0x7fa1980d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 --2- 172.21.15.43:0/3607827061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1980d3410 0x7fa1980b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 >> 172.21.15.43:0/3607827061 conn(0x7fa1980d1000 msgr2=0x7fa198143b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:05.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 shutdown_connections 2024-06-13T11:38:05.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.124+0000 7fa19d79e640 1 -- 172.21.15.43:0/3607827061 wait complete. 2024-06-13T11:38:05.134 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-06-13T11:38:03.361758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253968,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720752,"statfs":{"total":773094113280,"available":772834050048,"internally_reserved":0,"allocated":4628480,"data_stored":2615524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001377"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060997+0000","last_change":"2024-06-13T11:37:56.323330+0000","last_active":"2024-06-13T11:37:58.060997+0000","last_peered":"2024-06-13T11:37:58.060997+0000","last_clean":"2024-06-13T11:37:58.060997+0000","last_became_active":"2024-06-13T11:37:56.323036+0000","last_became_peered":"2024-06-13T11:37:56.323036+0000","last_unstale":"2024-06-13T11:37:58.060997+0000","last_undegraded":"2024-06-13T11:37:58.060997+0000","last_fullsized":"2024-06-13T11:37:58.060997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:43.855989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060814+0000","last_change":"2024-06-13T11:37:56.317705+0000","last_active":"2024-06-13T11:37:58.060814+0000","last_peered":"2024-06-13T11:37:58.060814+0000","last_clean":"2024-06-13T11:37:58.060814+0000","last_became_active":"2024-06-13T11:37:56.317411+0000","last_became_peered":"2024-06-13T11:37:56.317411+0000","last_unstale":"2024-06-13T11:37:58.060814+0000","last_undegraded":"2024-06-13T11:37:58.060814+0000","last_fullsized":"2024-06-13T11:37:58.060814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:28:27.687449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087417+0000","last_change":"2024-06-13T11:37:56.331226+0000","last_active":"2024-06-13T11:37:58.087417+0000","last_peered":"2024-06-13T11:37:58.087417+0000","last_clean":"2024-06-13T11:37:58.087417+0000","last_became_active":"2024-06-13T11:37:56.330954+0000","last_became_peered":"2024-06-13T11:37:56.330954+0000","last_unstale":"2024-06-13T11:37:58.087417+0000","last_undegraded":"2024-06-13T11:37:58.087417+0000","last_fullsized":"2024-06-13T11:37:58.087417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:22.710612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318326+0000","last_change":"2024-06-13T11:37:56.328375+0000","last_active":"2024-06-13T11:37:57.318326+0000","last_peered":"2024-06-13T11:37:57.318326+0000","last_clean":"2024-06-13T11:37:57.318326+0000","last_became_active":"2024-06-13T11:37:56.327777+0000","last_became_peered":"2024-06-13T11:37:56.327777+0000","last_unstale":"2024-06-13T11:37:57.318326+0000","last_undegraded":"2024-06-13T11:37:57.318326+0000","last_fullsized":"2024-06-13T11:37:57.318326+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:15:40.825959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318057+0000","last_change":"2024-06-13T11:37:56.330392+0000","last_active":"2024-06-13T11:37:57.318057+0000","last_peered":"2024-06-13T11:37:57.318057+0000","last_clean":"2024-06-13T11:37:57.318057+0000","last_became_active":"2024-06-13T11:37:56.330114+0000","last_became_peered":"2024-06-13T11:37:56.330114+0000","last_unstale":"2024-06-13T11:37:57.318057+0000","last_undegraded":"2024-06-13T11:37:57.318057+0000","last_fullsized":"2024-06-13T11:37:57.318057+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:47:48.796315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087483+0000","last_change":"2024-06-13T11:37:56.316382+0000","last_active":"2024-06-13T11:37:58.087483+0000","last_peered":"2024-06-13T11:37:58.087483+0000","last_clean":"2024-06-13T11:37:58.087483+0000","last_became_active":"2024-06-13T11:37:56.316079+0000","last_became_peered":"2024-06-13T11:37:56.316079+0000","last_unstale":"2024-06-13T11:37:58.087483+0000","last_undegraded":"2024-06-13T11:37:58.087483+0000","last_fullsized":"2024-06-13T11:37:58.087483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:21:41.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318834+0000","last_change":"2024-06-13T11:37:56.320153+0000","last_active":"2024-06-13T11:37:57.318834+0000","last_peered":"2024-06-13T11:37:57.318834+0000","last_clean":"2024-06-13T11:37:57.318834+0000","last_became_active":"2024-06-13T11:37:56.319164+0000","last_became_peered":"2024-06-13T11:37:56.319164+0000","last_unstale":"2024-06-13T11:37:57.318834+0000","last_undegraded":"2024-06-13T11:37:57.318834+0000","last_fullsized":"2024-06-13T11:37:57.318834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:26.092643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060443+0000","last_change":"2024-06-13T11:37:56.329963+0000","last_active":"2024-06-13T11:37:58.060443+0000","last_peered":"2024-06-13T11:37:58.060443+0000","last_clean":"2024-06-13T11:37:58.060443+0000","last_became_active":"2024-06-13T11:37:56.329661+0000","last_became_peered":"2024-06-13T11:37:56.329661+0000","last_unstale":"2024-06-13T11:37:58.060443+0000","last_undegraded":"2024-06-13T11:37:58.060443+0000","last_fullsized":"2024-06-13T11:37:58.060443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:14:49.700965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087366+0000","last_change":"2024-06-13T11:37:56.323714+0000","last_active":"2024-06-13T11:37:58.087366+0000","last_peered":"2024-06-13T11:37:58.087366+0000","last_clean":"2024-06-13T11:37:58.087366+0000","last_became_active":"2024-06-13T11:37:56.323416+0000","last_became_peered":"2024-06-13T11:37:56.323416+0000","last_unstale":"2024-06-13T11:37:58.087366+0000","last_undegraded":"2024-06-13T11:37:58.087366+0000","last_fullsized":"2024-06-13T11:37:58.087366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:41:16.066555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320246+0000","last_change":"2024-06-13T11:37:56.326263+0000","last_active":"2024-06-13T11:37:57.320246+0000","last_peered":"2024-06-13T11:37:57.320246+0000","last_clean":"2024-06-13T11:37:57.320246+0000","last_became_active":"2024-06-13T11:37:56.325928+0000","last_became_peered":"2024-06-13T11:37:56.325928+0000","last_unstale":"2024-06-13T11:37:57.320246+0000","last_undegraded":"2024-06-13T11:37:57.320246+0000","last_fullsized":"2024-06-13T11:37:57.320246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:02:13.502216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319650+0000","last_change":"2024-06-13T11:37:56.328875+0000","last_active":"2024-06-13T11:37:57.319650+0000","last_peered":"2024-06-13T11:37:57.319650+0000","last_clean":"2024-06-13T11:37:57.319650+0000","last_became_active":"2024-06-13T11:37:56.328466+0000","last_became_peered":"2024-06-13T11:37:56.328466+0000","last_unstale":"2024-06-13T11:37:57.319650+0000","last_undegraded":"2024-06-13T11:37:57.319650+0000","last_fullsized":"2024-06-13T11:37:57.319650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:21:56.001821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087111+0000","last_change":"2024-06-13T11:37:56.329293+0000","last_active":"2024-06-13T11:37:58.087111+0000","last_peered":"2024-06-13T11:37:58.087111+0000","last_clean":"2024-06-13T11:37:58.087111+0000","last_became_active":"2024-06-13T11:37:56.329023+0000","last_became_peered":"2024-06-13T11:37:56.329023+0000","last_unstale":"2024-06-13T11:37:58.087111+0000","last_undegraded":"2024-06-13T11:37:58.087111+0000","last_fullsized":"2024-06-13T11:37:58.087111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:43.606286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318818+0000","last_change":"2024-06-13T11:37:56.327065+0000","last_active":"2024-06-13T11:37:57.318818+0000","last_peered":"2024-06-13T11:37:57.318818+0000","last_clean":"2024-06-13T11:37:57.318818+0000","last_became_active":"2024-06-13T11:37:56.326677+0000","last_became_peered":"2024-06-13T11:37:56.326677+0000","last_unstale":"2024-06-13T11:37:57.318818+0000","last_undegraded":"2024-06-13T11:37:57.318818+0000","last_fullsized":"2024-06-13T11:37:57.318818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:33:50.271160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086566+0000","last_change":"2024-06-13T11:37:56.333377+0000","last_active":"2024-06-13T11:37:58.086566+0000","last_peered":"2024-06-13T11:37:58.086566+0000","last_clean":"2024-06-13T11:37:58.086566+0000","last_became_active":"2024-06-13T11:37:56.333061+0000","last_became_peered":"2024-06-13T11:37:56.333061+0000","last_unstale":"2024-06-13T11:37:58.086566+0000","last_undegraded":"2024-06-13T11:37:58.086566+0000","last_fullsized":"2024-06-13T11:37:58.086566+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:04:05.167545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318939+0000","last_change":"2024-06-13T11:37:56.320422+0000","last_active":"2024-06-13T11:37:57.318939+0000","last_peered":"2024-06-13T11:37:57.318939+0000","last_clean":"2024-06-13T11:37:57.318939+0000","last_became_active":"2024-06-13T11:37:56.319882+0000","last_became_peered":"2024-06-13T11:37:56.319882+0000","last_unstale":"2024-06-13T11:37:57.318939+0000","last_undegraded":"2024-06-13T11:37:57.318939+0000","last_fullsized":"2024-06-13T11:37:57.318939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:37.125682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.459904+0000","last_change":"2024-06-13T11:37:56.337108+0000","last_active":"2024-06-13T11:37:57.459904+0000","last_peered":"2024-06-13T11:37:57.459904+0000","last_clean":"2024-06-13T11:37:57.459904+0000","last_became_active":"2024-06-13T11:37:56.336726+0000","last_became_peered":"2024-06-13T11:37:56.336726+0000","last_unstale":"2024-06-13T11:37:57.459904+0000","last_undegraded":"2024-06-13T11:37:57.459904+0000","last_fullsized":"2024-06-13T11:37:57.459904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:57:21.388732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460525+0000","last_change":"2024-06-13T11:37:56.336965+0000","last_active":"2024-06-13T11:37:57.460525+0000","last_peered":"2024-06-13T11:37:57.460525+0000","last_clean":"2024-06-13T11:37:57.460525+0000","last_became_active":"2024-06-13T11:37:56.336655+0000","last_became_peered":"2024-06-13T11:37:56.336655+0000","last_unstale":"2024-06-13T11:37:57.460525+0000","last_undegraded":"2024-06-13T11:37:57.460525+0000","last_fullsized":"2024-06-13T11:37:57.460525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:37.125682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319351+0000","last_change":"2024-06-13T11:37:56.328596+0000","last_active":"2024-06-13T11:37:57.319351+0000","last_peered":"2024-06-13T11:37:57.319351+0000","last_clean":"2024-06-13T11:37:57.319351+0000","last_became_active":"2024-06-13T11:37:56.328108+0000","last_became_peered":"2024-06-13T11:37:56.328108+0000","last_unstale":"2024-06-13T11:37:57.319351+0000","last_undegraded":"2024-06-13T11:37:57.319351+0000","last_fullsized":"2024-06-13T11:37:57.319351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:34.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318530+0000","last_change":"2024-06-13T11:37:56.317302+0000","last_active":"2024-06-13T11:37:57.318530+0000","last_peered":"2024-06-13T11:37:57.318530+0000","last_clean":"2024-06-13T11:37:57.318530+0000","last_became_active":"2024-06-13T11:37:56.316660+0000","last_became_peered":"2024-06-13T11:37:56.316660+0000","last_unstale":"2024-06-13T11:37:57.318530+0000","last_undegraded":"2024-06-13T11:37:57.318530+0000","last_fullsized":"2024-06-13T11:37:57.318530+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:34.667389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319498+0000","last_change":"2024-06-13T11:37:56.327683+0000","last_active":"2024-06-13T11:37:57.319498+0000","last_peered":"2024-06-13T11:37:57.319498+0000","last_clean":"2024-06-13T11:37:57.319498+0000","last_became_active":"2024-06-13T11:37:56.327288+0000","last_became_peered":"2024-06-13T11:37:56.327288+0000","last_unstale":"2024-06-13T11:37:57.319498+0000","last_undegraded":"2024-06-13T11:37:57.319498+0000","last_fullsized":"2024-06-13T11:37:57.319498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:56.074443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319999+0000","last_change":"2024-06-13T11:37:56.320203+0000","last_active":"2024-06-13T11:37:57.319999+0000","last_peered":"2024-06-13T11:37:57.319999+0000","last_clean":"2024-06-13T11:37:57.319999+0000","last_became_active":"2024-06-13T11:37:56.319914+0000","last_became_peered":"2024-06-13T11:37:56.319914+0000","last_unstale":"2024-06-13T11:37:57.319999+0000","last_undegraded":"2024-06-13T11:37:57.319999+0000","last_fullsized":"2024-06-13T11:37:57.319999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:15.616573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086690+0000","last_change":"2024-06-13T11:37:56.328768+0000","last_active":"2024-06-13T11:37:58.086690+0000","last_peered":"2024-06-13T11:37:58.086690+0000","last_clean":"2024-06-13T11:37:58.086690+0000","last_became_active":"2024-06-13T11:37:56.328430+0000","last_became_peered":"2024-06-13T11:37:56.328430+0000","last_unstale":"2024-06-13T11:37:58.086690+0000","last_undegraded":"2024-06-13T11:37:58.086690+0000","last_fullsized":"2024-06-13T11:37:58.086690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:12:18.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.459994+0000","last_change":"2024-06-13T11:37:56.333430+0000","last_active":"2024-06-13T11:37:57.459994+0000","last_peered":"2024-06-13T11:37:57.459994+0000","last_clean":"2024-06-13T11:37:57.459994+0000","last_became_active":"2024-06-13T11:37:56.333164+0000","last_became_peered":"2024-06-13T11:37:56.333164+0000","last_unstale":"2024-06-13T11:37:57.459994+0000","last_undegraded":"2024-06-13T11:37:57.459994+0000","last_fullsized":"2024-06-13T11:37:57.459994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:38:46.544540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.317952+0000","last_change":"2024-06-13T11:37:56.326591+0000","last_active":"2024-06-13T11:37:57.317952+0000","last_peered":"2024-06-13T11:37:57.317952+0000","last_clean":"2024-06-13T11:37:57.317952+0000","last_became_active":"2024-06-13T11:37:56.326263+0000","last_became_peered":"2024-06-13T11:37:56.326263+0000","last_unstale":"2024-06-13T11:37:57.317952+0000","last_undegraded":"2024-06-13T11:37:57.317952+0000","last_fullsized":"2024-06-13T11:37:57.317952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:55:44.496615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320110+0000","last_change":"2024-06-13T11:37:56.327264+0000","last_active":"2024-06-13T11:37:57.320110+0000","last_peered":"2024-06-13T11:37:57.320110+0000","last_clean":"2024-06-13T11:37:57.320110+0000","last_became_active":"2024-06-13T11:37:56.326938+0000","last_became_peered":"2024-06-13T11:37:56.326938+0000","last_unstale":"2024-06-13T11:37:57.320110+0000","last_undegraded":"2024-06-13T11:37:57.320110+0000","last_fullsized":"2024-06-13T11:37:57.320110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:58.642397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087219+0000","last_change":"2024-06-13T11:37:56.325540+0000","last_active":"2024-06-13T11:37:58.087219+0000","last_peered":"2024-06-13T11:37:58.087219+0000","last_clean":"2024-06-13T11:37:58.087219+0000","last_became_active":"2024-06-13T11:37:56.325219+0000","last_became_peered":"2024-06-13T11:37:56.325219+0000","last_unstale":"2024-06-13T11:37:58.087219+0000","last_undegraded":"2024-06-13T11:37:58.087219+0000","last_fullsized":"2024-06-13T11:37:58.087219+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:24.453927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319823+0000","last_change":"2024-06-13T11:37:56.316438+0000","last_active":"2024-06-13T11:37:57.319823+0000","last_peered":"2024-06-13T11:37:57.319823+0000","last_clean":"2024-06-13T11:37:57.319823+0000","last_became_active":"2024-06-13T11:37:56.316174+0000","last_became_peered":"2024-06-13T11:37:56.316174+0000","last_unstale":"2024-06-13T11:37:57.319823+0000","last_undegraded":"2024-06-13T11:37:57.319823+0000","last_fullsized":"2024-06-13T11:37:57.319823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:47.965043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319990+0000","last_change":"2024-06-13T11:37:56.323559+0000","last_active":"2024-06-13T11:37:57.319990+0000","last_peered":"2024-06-13T11:37:57.319990+0000","last_clean":"2024-06-13T11:37:57.319990+0000","last_became_active":"2024-06-13T11:37:56.323291+0000","last_became_peered":"2024-06-13T11:37:56.323291+0000","last_unstale":"2024-06-13T11:37:57.319990+0000","last_undegraded":"2024-06-13T11:37:57.319990+0000","last_fullsized":"2024-06-13T11:37:57.319990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:32:42.345913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319362+0000","last_change":"2024-06-13T11:37:56.317261+0000","last_active":"2024-06-13T11:37:57.319362+0000","last_peered":"2024-06-13T11:37:57.319362+0000","last_clean":"2024-06-13T11:37:57.319362+0000","last_became_active":"2024-06-13T11:37:56.316998+0000","last_became_peered":"2024-06-13T11:37:56.316998+0000","last_unstale":"2024-06-13T11:37:57.319362+0000","last_undegraded":"2024-06-13T11:37:57.319362+0000","last_fullsized":"2024-06-13T11:37:57.319362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:19:55.201823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319351+0000","last_change":"2024-06-13T11:37:56.318813+0000","last_active":"2024-06-13T11:37:57.319351+0000","last_peered":"2024-06-13T11:37:57.319351+0000","last_clean":"2024-06-13T11:37:57.319351+0000","last_became_active":"2024-06-13T11:37:56.318534+0000","last_became_peered":"2024-06-13T11:37:56.318534+0000","last_unstale":"2024-06-13T11:37:57.319351+0000","last_undegraded":"2024-06-13T11:37:57.319351+0000","last_fullsized":"2024-06-13T11:37:57.319351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:20.982921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460136+0000","last_change":"2024-06-13T11:37:56.334243+0000","last_active":"2024-06-13T11:37:57.460136+0000","last_peered":"2024-06-13T11:37:57.460136+0000","last_clean":"2024-06-13T11:37:57.460136+0000","last_became_active":"2024-06-13T11:37:56.333952+0000","last_became_peered":"2024-06-13T11:37:56.333952+0000","last_unstale":"2024-06-13T11:37:57.460136+0000","last_undegraded":"2024-06-13T11:37:57.460136+0000","last_fullsized":"2024-06-13T11:37:57.460136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:28.052669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087286+0000","last_change":"2024-06-13T11:37:56.318049+0000","last_active":"2024-06-13T11:37:58.087286+0000","last_peered":"2024-06-13T11:37:58.087286+0000","last_clean":"2024-06-13T11:37:58.087286+0000","last_became_active":"2024-06-13T11:37:56.317769+0000","last_became_peered":"2024-06-13T11:37:56.317769+0000","last_unstale":"2024-06-13T11:37:58.087286+0000","last_undegraded":"2024-06-13T11:37:58.087286+0000","last_fullsized":"2024-06-13T11:37:58.087286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:43.606286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460476+0000","last_change":"2024-06-13T11:37:56.336846+0000","last_active":"2024-06-13T11:37:57.460476+0000","last_peered":"2024-06-13T11:37:57.460476+0000","last_clean":"2024-06-13T11:37:57.460476+0000","last_became_active":"2024-06-13T11:37:56.336555+0000","last_became_peered":"2024-06-13T11:37:56.336555+0000","last_unstale":"2024-06-13T11:37:57.460476+0000","last_undegraded":"2024-06-13T11:37:57.460476+0000","last_fullsized":"2024-06-13T11:37:57.460476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:26.092643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320173+0000","last_change":"2024-06-13T11:37:55.305450+0000","last_active":"2024-06-13T11:37:57.320173+0000","last_peered":"2024-06-13T11:37:57.320173+0000","last_clean":"2024-06-13T11:37:57.320173+0000","last_became_active":"2024-06-13T11:37:55.305165+0000","last_became_peered":"2024-06-13T11:37:55.305165+0000","last_unstale":"2024-06-13T11:37:57.320173+0000","last_undegraded":"2024-06-13T11:37:57.320173+0000","last_fullsized":"2024-06-13T11:37:57.320173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:52.073467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087960+0000","last_change":"2024-06-13T11:37:56.330952+0000","last_active":"2024-06-13T11:37:58.087960+0000","last_peered":"2024-06-13T11:37:58.087960+0000","last_clean":"2024-06-13T11:37:58.087960+0000","last_became_active":"2024-06-13T11:37:56.330604+0000","last_became_peered":"2024-06-13T11:37:56.330604+0000","last_unstale":"2024-06-13T11:37:58.087960+0000","last_undegraded":"2024-06-13T11:37:58.087960+0000","last_fullsized":"2024-06-13T11:37:58.087960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:33:06.820994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087072+0000","last_change":"2024-06-13T11:37:55.319411+0000","last_active":"2024-06-13T11:37:58.087072+0000","last_peered":"2024-06-13T11:37:58.087072+0000","last_clean":"2024-06-13T11:37:58.087072+0000","last_became_active":"2024-06-13T11:37:55.318305+0000","last_became_peered":"2024-06-13T11:37:55.318305+0000","last_unstale":"2024-06-13T11:37:58.087072+0000","last_undegraded":"2024-06-13T11:37:58.087072+0000","last_fullsized":"2024-06-13T11:37:58.087072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:15:12.781526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087013+0000","last_change":"2024-06-13T11:37:56.334255+0000","last_active":"2024-06-13T11:37:58.087013+0000","last_peered":"2024-06-13T11:37:58.087013+0000","last_clean":"2024-06-13T11:37:58.087013+0000","last_became_active":"2024-06-13T11:37:56.333761+0000","last_became_peered":"2024-06-13T11:37:56.333761+0000","last_unstale":"2024-06-13T11:37:58.087013+0000","last_undegraded":"2024-06-13T11:37:58.087013+0000","last_fullsized":"2024-06-13T11:37:58.087013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:57:21.388732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087971+0000","last_change":"2024-06-13T11:37:55.318481+0000","last_active":"2024-06-13T11:37:58.087971+0000","last_peered":"2024-06-13T11:37:58.087971+0000","last_clean":"2024-06-13T11:37:58.087971+0000","last_became_active":"2024-06-13T11:37:55.318164+0000","last_became_peered":"2024-06-13T11:37:55.318164+0000","last_unstale":"2024-06-13T11:37:58.087971+0000","last_undegraded":"2024-06-13T11:37:58.087971+0000","last_fullsized":"2024-06-13T11:37:58.087971+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:08:33.823945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060985+0000","last_change":"2024-06-13T11:37:56.318534+0000","last_active":"2024-06-13T11:37:58.060985+0000","last_peered":"2024-06-13T11:37:58.060985+0000","last_clean":"2024-06-13T11:37:58.060985+0000","last_became_active":"2024-06-13T11:37:56.318248+0000","last_became_peered":"2024-06-13T11:37:56.318248+0000","last_unstale":"2024-06-13T11:37:58.060985+0000","last_undegraded":"2024-06-13T11:37:58.060985+0000","last_fullsized":"2024-06-13T11:37:58.060985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:32:11.630092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086805+0000","last_change":"2024-06-13T11:37:55.308705+0000","last_active":"2024-06-13T11:37:58.086805+0000","last_peered":"2024-06-13T11:37:58.086805+0000","last_clean":"2024-06-13T11:37:58.086805+0000","last_became_active":"2024-06-13T11:37:55.308399+0000","last_became_peered":"2024-06-13T11:37:55.308399+0000","last_unstale":"2024-06-13T11:37:58.086805+0000","last_undegraded":"2024-06-13T11:37:58.086805+0000","last_fullsized":"2024-06-13T11:37:58.086805+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086925+0000","last_change":"2024-06-13T11:37:56.325979+0000","last_active":"2024-06-13T11:37:58.086925+0000","last_peered":"2024-06-13T11:37:58.086925+0000","last_clean":"2024-06-13T11:37:58.086925+0000","last_became_active":"2024-06-13T11:37:56.325682+0000","last_became_peered":"2024-06-13T11:37:56.325682+0000","last_unstale":"2024-06-13T11:37:58.086925+0000","last_undegraded":"2024-06-13T11:37:58.086925+0000","last_fullsized":"2024-06-13T11:37:58.086925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:38:24.453927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320100+0000","last_change":"2024-06-13T11:37:55.314283+0000","last_active":"2024-06-13T11:37:57.320100+0000","last_peered":"2024-06-13T11:37:57.320100+0000","last_clean":"2024-06-13T11:37:57.320100+0000","last_became_active":"2024-06-13T11:37:55.313981+0000","last_became_peered":"2024-06-13T11:37:55.313981+0000","last_unstale":"2024-06-13T11:37:57.320100+0000","last_undegraded":"2024-06-13T11:37:57.320100+0000","last_fullsized":"2024-06-13T11:37:57.320100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:55:32.867795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319007+0000","last_change":"2024-06-13T11:37:56.320173+0000","last_active":"2024-06-13T11:37:57.319007+0000","last_peered":"2024-06-13T11:37:57.319007+0000","last_clean":"2024-06-13T11:37:57.319007+0000","last_became_active":"2024-06-13T11:37:56.319550+0000","last_became_peered":"2024-06-13T11:37:56.319550+0000","last_unstale":"2024-06-13T11:37:57.319007+0000","last_undegraded":"2024-06-13T11:37:57.319007+0000","last_fullsized":"2024-06-13T11:37:57.319007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:00:30.487877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460025+0000","last_change":"2024-06-13T11:37:55.319302+0000","last_active":"2024-06-13T11:37:57.460025+0000","last_peered":"2024-06-13T11:37:57.460025+0000","last_clean":"2024-06-13T11:37:57.460025+0000","last_became_active":"2024-06-13T11:37:55.318884+0000","last_became_peered":"2024-06-13T11:37:55.318884+0000","last_unstale":"2024-06-13T11:37:57.460025+0000","last_undegraded":"2024-06-13T11:37:57.460025+0000","last_fullsized":"2024-06-13T11:37:57.460025+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086983+0000","last_change":"2024-06-13T11:37:56.325772+0000","last_active":"2024-06-13T11:37:58.086983+0000","last_peered":"2024-06-13T11:37:58.086983+0000","last_clean":"2024-06-13T11:37:58.086983+0000","last_became_active":"2024-06-13T11:37:56.325245+0000","last_became_peered":"2024-06-13T11:37:56.325245+0000","last_unstale":"2024-06-13T11:37:58.086983+0000","last_undegraded":"2024-06-13T11:37:58.086983+0000","last_fullsized":"2024-06-13T11:37:58.086983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:45:25.308172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087561+0000","last_change":"2024-06-13T11:37:55.312037+0000","last_active":"2024-06-13T11:37:58.087561+0000","last_peered":"2024-06-13T11:37:58.087561+0000","last_clean":"2024-06-13T11:37:58.087561+0000","last_became_active":"2024-06-13T11:37:55.311676+0000","last_became_peered":"2024-06-13T11:37:55.311676+0000","last_unstale":"2024-06-13T11:37:58.087561+0000","last_undegraded":"2024-06-13T11:37:58.087561+0000","last_fullsized":"2024-06-13T11:37:58.087561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060601+0000","last_change":"2024-06-13T11:37:56.331802+0000","last_active":"2024-06-13T11:37:58.060601+0000","last_peered":"2024-06-13T11:37:58.060601+0000","last_clean":"2024-06-13T11:37:58.060601+0000","last_became_active":"2024-06-13T11:37:56.331443+0000","last_became_peered":"2024-06-13T11:37:56.331443+0000","last_unstale":"2024-06-13T11:37:58.060601+0000","last_undegraded":"2024-06-13T11:37:58.060601+0000","last_fullsized":"2024-06-13T11:37:58.060601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:03:13.193744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086443+0000","last_change":"2024-06-13T11:37:55.309937+0000","last_active":"2024-06-13T11:37:58.086443+0000","last_peered":"2024-06-13T11:37:58.086443+0000","last_clean":"2024-06-13T11:37:58.086443+0000","last_became_active":"2024-06-13T11:37:55.309677+0000","last_became_peered":"2024-06-13T11:37:55.309677+0000","last_unstale":"2024-06-13T11:37:58.086443+0000","last_undegraded":"2024-06-13T11:37:58.086443+0000","last_fullsized":"2024-06-13T11:37:58.086443+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:06:17.518923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318342+0000","last_change":"2024-06-13T11:37:56.328114+0000","last_active":"2024-06-13T11:37:57.318342+0000","last_peered":"2024-06-13T11:37:57.318342+0000","last_clean":"2024-06-13T11:37:57.318342+0000","last_became_active":"2024-06-13T11:37:56.327404+0000","last_became_peered":"2024-06-13T11:37:56.327404+0000","last_unstale":"2024-06-13T11:37:57.318342+0000","last_undegraded":"2024-06-13T11:37:57.318342+0000","last_fullsized":"2024-06-13T11:37:57.318342+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:53.078384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.061064+0000","last_change":"2024-06-13T11:37:55.317546+0000","last_active":"2024-06-13T11:37:58.061064+0000","last_peered":"2024-06-13T11:37:58.061064+0000","last_clean":"2024-06-13T11:37:58.061064+0000","last_became_active":"2024-06-13T11:37:55.317278+0000","last_became_peered":"2024-06-13T11:37:55.317278+0000","last_unstale":"2024-06-13T11:37:58.061064+0000","last_undegraded":"2024-06-13T11:37:58.061064+0000","last_fullsized":"2024-06-13T11:37:58.061064+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:58:57.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460381+0000","last_change":"2024-06-13T11:37:56.333326+0000","last_active":"2024-06-13T11:37:57.460381+0000","last_peered":"2024-06-13T11:37:57.460381+0000","last_clean":"2024-06-13T11:37:57.460381+0000","last_became_active":"2024-06-13T11:37:56.332950+0000","last_became_peered":"2024-06-13T11:37:56.332950+0000","last_unstale":"2024-06-13T11:37:57.460381+0000","last_undegraded":"2024-06-13T11:37:57.460381+0000","last_fullsized":"2024-06-13T11:37:57.460381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:54:32.345878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320387+0000","last_change":"2024-06-13T11:37:55.313056+0000","last_active":"2024-06-13T11:37:57.320387+0000","last_peered":"2024-06-13T11:37:57.320387+0000","last_clean":"2024-06-13T11:37:57.320387+0000","last_became_active":"2024-06-13T11:37:55.312782+0000","last_became_peered":"2024-06-13T11:37:55.312782+0000","last_unstale":"2024-06-13T11:37:57.320387+0000","last_undegraded":"2024-06-13T11:37:57.320387+0000","last_fullsized":"2024-06-13T11:37:57.320387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:02:06.789673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087308+0000","last_change":"2024-06-13T11:37:56.335836+0000","last_active":"2024-06-13T11:37:58.087308+0000","last_peered":"2024-06-13T11:37:58.087308+0000","last_clean":"2024-06-13T11:37:58.087308+0000","last_became_active":"2024-06-13T11:37:56.335541+0000","last_became_peered":"2024-06-13T11:37:56.335541+0000","last_unstale":"2024-06-13T11:37:58.087308+0000","last_undegraded":"2024-06-13T11:37:58.087308+0000","last_fullsized":"2024-06-13T11:37:58.087308+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:33:06.820994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319784+0000","last_change":"2024-06-13T11:37:55.312146+0000","last_active":"2024-06-13T11:37:57.319784+0000","last_peered":"2024-06-13T11:37:57.319784+0000","last_clean":"2024-06-13T11:37:57.319784+0000","last_became_active":"2024-06-13T11:37:55.311692+0000","last_became_peered":"2024-06-13T11:37:55.311692+0000","last_unstale":"2024-06-13T11:37:57.319784+0000","last_undegraded":"2024-06-13T11:37:57.319784+0000","last_fullsized":"2024-06-13T11:37:57.319784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:15:52.165608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086889+0000","last_change":"2024-06-13T11:37:56.328733+0000","last_active":"2024-06-13T11:37:58.086889+0000","last_peered":"2024-06-13T11:37:58.086889+0000","last_clean":"2024-06-13T11:37:58.086889+0000","last_became_active":"2024-06-13T11:37:56.328353+0000","last_became_peered":"2024-06-13T11:37:56.328353+0000","last_unstale":"2024-06-13T11:37:58.086889+0000","last_undegraded":"2024-06-13T11:37:58.086889+0000","last_fullsized":"2024-06-13T11:37:58.086889+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:44:31.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060792+0000","last_change":"2024-06-13T11:37:55.309442+0000","last_active":"2024-06-13T11:37:58.060792+0000","last_peered":"2024-06-13T11:37:58.060792+0000","last_clean":"2024-06-13T11:37:58.060792+0000","last_became_active":"2024-06-13T11:37:55.309109+0000","last_became_peered":"2024-06-13T11:37:55.309109+0000","last_unstale":"2024-06-13T11:37:58.060792+0000","last_undegraded":"2024-06-13T11:37:58.060792+0000","last_fullsized":"2024-06-13T11:37:58.060792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:15:55.069527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087223+0000","last_change":"2024-06-13T11:37:56.323618+0000","last_active":"2024-06-13T11:37:58.087223+0000","last_peered":"2024-06-13T11:37:58.087223+0000","last_clean":"2024-06-13T11:37:58.087223+0000","last_became_active":"2024-06-13T11:37:56.323333+0000","last_became_peered":"2024-06-13T11:37:56.323333+0000","last_unstale":"2024-06-13T11:37:58.087223+0000","last_undegraded":"2024-06-13T11:37:58.087223+0000","last_fullsized":"2024-06-13T11:37:58.087223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:58:30.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060763+0000","last_change":"2024-06-13T11:37:55.316960+0000","last_active":"2024-06-13T11:37:58.060763+0000","last_peered":"2024-06-13T11:37:58.060763+0000","last_clean":"2024-06-13T11:37:58.060763+0000","last_became_active":"2024-06-13T11:37:55.316663+0000","last_became_peered":"2024-06-13T11:37:55.316663+0000","last_unstale":"2024-06-13T11:37:58.060763+0000","last_undegraded":"2024-06-13T11:37:58.060763+0000","last_fullsized":"2024-06-13T11:37:58.060763+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:06.986712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060605+0000","last_change":"2024-06-13T11:37:56.327997+0000","last_active":"2024-06-13T11:37:58.060605+0000","last_peered":"2024-06-13T11:37:58.060605+0000","last_clean":"2024-06-13T11:37:58.060605+0000","last_became_active":"2024-06-13T11:37:56.327722+0000","last_became_peered":"2024-06-13T11:37:56.327722+0000","last_unstale":"2024-06-13T11:37:58.060605+0000","last_undegraded":"2024-06-13T11:37:58.060605+0000","last_fullsized":"2024-06-13T11:37:58.060605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:53:47.486525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087421+0000","last_change":"2024-06-13T11:37:55.310340+0000","last_active":"2024-06-13T11:37:58.087421+0000","last_peered":"2024-06-13T11:37:58.087421+0000","last_clean":"2024-06-13T11:37:58.087421+0000","last_became_active":"2024-06-13T11:37:55.310063+0000","last_became_peered":"2024-06-13T11:37:55.310063+0000","last_unstale":"2024-06-13T11:37:58.087421+0000","last_undegraded":"2024-06-13T11:37:58.087421+0000","last_fullsized":"2024-06-13T11:37:58.087421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:57:38.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460128+0000","last_change":"2024-06-13T11:37:56.333319+0000","last_active":"2024-06-13T11:37:57.460128+0000","last_peered":"2024-06-13T11:37:57.460128+0000","last_clean":"2024-06-13T11:37:57.460128+0000","last_became_active":"2024-06-13T11:37:56.333028+0000","last_became_peered":"2024-06-13T11:37:56.333028+0000","last_unstale":"2024-06-13T11:37:57.460128+0000","last_undegraded":"2024-06-13T11:37:57.460128+0000","last_fullsized":"2024-06-13T11:37:57.460128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:53.607284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319065+0000","last_change":"2024-06-13T11:37:55.305492+0000","last_active":"2024-06-13T11:37:57.319065+0000","last_peered":"2024-06-13T11:37:57.319065+0000","last_clean":"2024-06-13T11:37:57.319065+0000","last_became_active":"2024-06-13T11:37:55.305173+0000","last_became_peered":"2024-06-13T11:37:55.305173+0000","last_unstale":"2024-06-13T11:37:57.319065+0000","last_undegraded":"2024-06-13T11:37:57.319065+0000","last_fullsized":"2024-06-13T11:37:57.319065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:29:34.230576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060533+0000","last_change":"2024-06-13T11:37:56.330323+0000","last_active":"2024-06-13T11:37:58.060533+0000","last_peered":"2024-06-13T11:37:58.060533+0000","last_clean":"2024-06-13T11:37:58.060533+0000","last_became_active":"2024-06-13T11:37:56.330008+0000","last_became_peered":"2024-06-13T11:37:56.330008+0000","last_unstale":"2024-06-13T11:37:58.060533+0000","last_undegraded":"2024-06-13T11:37:58.060533+0000","last_fullsized":"2024-06-13T11:37:58.060533+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:14:48.312863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.459907+0000","last_change":"2024-06-13T11:37:55.317870+0000","last_active":"2024-06-13T11:37:57.459907+0000","last_peered":"2024-06-13T11:37:57.459907+0000","last_clean":"2024-06-13T11:37:57.459907+0000","last_became_active":"2024-06-13T11:37:55.317569+0000","last_became_peered":"2024-06-13T11:37:55.317569+0000","last_unstale":"2024-06-13T11:37:57.459907+0000","last_undegraded":"2024-06-13T11:37:57.459907+0000","last_fullsized":"2024-06-13T11:37:57.459907+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060868+0000","last_change":"2024-06-13T11:37:56.318768+0000","last_active":"2024-06-13T11:37:58.060868+0000","last_peered":"2024-06-13T11:37:58.060868+0000","last_clean":"2024-06-13T11:37:58.060868+0000","last_became_active":"2024-06-13T11:37:56.318414+0000","last_became_peered":"2024-06-13T11:37:56.318414+0000","last_unstale":"2024-06-13T11:37:58.060868+0000","last_undegraded":"2024-06-13T11:37:58.060868+0000","last_fullsized":"2024-06-13T11:37:58.060868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:49.089537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320545+0000","last_change":"2024-06-13T11:37:55.314832+0000","last_active":"2024-06-13T11:37:57.320545+0000","last_peered":"2024-06-13T11:37:57.320545+0000","last_clean":"2024-06-13T11:37:57.320545+0000","last_became_active":"2024-06-13T11:37:55.314553+0000","last_became_peered":"2024-06-13T11:37:55.314553+0000","last_unstale":"2024-06-13T11:37:57.320545+0000","last_undegraded":"2024-06-13T11:37:57.320545+0000","last_fullsized":"2024-06-13T11:37:57.320545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:50:33.732710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319702+0000","last_change":"2024-06-13T11:37:56.329960+0000","last_active":"2024-06-13T11:37:57.319702+0000","last_peered":"2024-06-13T11:37:57.319702+0000","last_clean":"2024-06-13T11:37:57.319702+0000","last_became_active":"2024-06-13T11:37:56.327480+0000","last_became_peered":"2024-06-13T11:37:56.327480+0000","last_unstale":"2024-06-13T11:37:57.319702+0000","last_undegraded":"2024-06-13T11:37:57.319702+0000","last_fullsized":"2024-06-13T11:37:57.319702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:45.716413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087074+0000","last_change":"2024-06-13T11:37:55.310530+0000","last_active":"2024-06-13T11:37:58.087074+0000","last_peered":"2024-06-13T11:37:58.087074+0000","last_clean":"2024-06-13T11:37:58.087074+0000","last_became_active":"2024-06-13T11:37:55.310267+0000","last_became_peered":"2024-06-13T11:37:55.310267+0000","last_unstale":"2024-06-13T11:37:58.087074+0000","last_undegraded":"2024-06-13T11:37:58.087074+0000","last_fullsized":"2024-06-13T11:37:58.087074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:30:47.763458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086982+0000","last_change":"2024-06-13T11:37:56.330670+0000","last_active":"2024-06-13T11:37:58.086982+0000","last_peered":"2024-06-13T11:37:58.086982+0000","last_clean":"2024-06-13T11:37:58.086982+0000","last_became_active":"2024-06-13T11:37:56.330391+0000","last_became_peered":"2024-06-13T11:37:56.330391+0000","last_unstale":"2024-06-13T11:37:58.086982+0000","last_undegraded":"2024-06-13T11:37:58.086982+0000","last_fullsized":"2024-06-13T11:37:58.086982+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:34.553237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318510+0000","last_change":"2024-06-13T11:37:55.315973+0000","last_active":"2024-06-13T11:37:57.318510+0000","last_peered":"2024-06-13T11:37:57.318510+0000","last_clean":"2024-06-13T11:37:57.318510+0000","last_became_active":"2024-06-13T11:37:55.315613+0000","last_became_peered":"2024-06-13T11:37:55.315613+0000","last_unstale":"2024-06-13T11:37:57.318510+0000","last_undegraded":"2024-06-13T11:37:57.318510+0000","last_fullsized":"2024-06-13T11:37:57.318510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:39:13.330192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318340+0000","last_change":"2024-06-13T11:37:56.317844+0000","last_active":"2024-06-13T11:37:57.318340+0000","last_peered":"2024-06-13T11:37:57.318340+0000","last_clean":"2024-06-13T11:37:57.318340+0000","last_became_active":"2024-06-13T11:37:56.317533+0000","last_became_peered":"2024-06-13T11:37:56.317533+0000","last_unstale":"2024-06-13T11:37:57.318340+0000","last_undegraded":"2024-06-13T11:37:57.318340+0000","last_fullsized":"2024-06-13T11:37:57.318340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:56.572143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087662+0000","last_change":"2024-06-13T11:37:55.317261+0000","last_active":"2024-06-13T11:37:58.087662+0000","last_peered":"2024-06-13T11:37:58.087662+0000","last_clean":"2024-06-13T11:37:58.087662+0000","last_became_active":"2024-06-13T11:37:55.316983+0000","last_became_peered":"2024-06-13T11:37:55.316983+0000","last_unstale":"2024-06-13T11:37:58.087662+0000","last_undegraded":"2024-06-13T11:37:58.087662+0000","last_fullsized":"2024-06-13T11:37:58.087662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:36:19.978004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460154+0000","last_change":"2024-06-13T11:37:56.332777+0000","last_active":"2024-06-13T11:37:57.460154+0000","last_peered":"2024-06-13T11:37:57.460154+0000","last_clean":"2024-06-13T11:37:57.460154+0000","last_became_active":"2024-06-13T11:37:56.332287+0000","last_became_peered":"2024-06-13T11:37:56.332287+0000","last_unstale":"2024-06-13T11:37:57.460154+0000","last_undegraded":"2024-06-13T11:37:57.460154+0000","last_fullsized":"2024-06-13T11:37:57.460154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:32:34.940913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318085+0000","last_change":"2024-06-13T11:37:55.318031+0000","last_active":"2024-06-13T11:37:57.318085+0000","last_peered":"2024-06-13T11:37:57.318085+0000","last_clean":"2024-06-13T11:37:57.318085+0000","last_became_active":"2024-06-13T11:37:55.316716+0000","last_became_peered":"2024-06-13T11:37:55.316716+0000","last_unstale":"2024-06-13T11:37:57.318085+0000","last_undegraded":"2024-06-13T11:37:57.318085+0000","last_fullsized":"2024-06-13T11:37:57.318085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:54:29.089099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087119+0000","last_change":"2024-06-13T11:37:56.336329+0000","last_active":"2024-06-13T11:37:58.087119+0000","last_peered":"2024-06-13T11:37:58.087119+0000","last_clean":"2024-06-13T11:37:58.087119+0000","last_became_active":"2024-06-13T11:37:56.335972+0000","last_became_peered":"2024-06-13T11:37:56.335972+0000","last_unstale":"2024-06-13T11:37:58.087119+0000","last_undegraded":"2024-06-13T11:37:58.087119+0000","last_fullsized":"2024-06-13T11:37:58.087119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:21:41.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318015+0000","last_change":"2024-06-13T11:37:55.312486+0000","last_active":"2024-06-13T11:37:57.318015+0000","last_peered":"2024-06-13T11:37:57.318015+0000","last_clean":"2024-06-13T11:37:57.318015+0000","last_became_active":"2024-06-13T11:37:55.312206+0000","last_became_peered":"2024-06-13T11:37:55.312206+0000","last_unstale":"2024-06-13T11:37:57.318015+0000","last_undegraded":"2024-06-13T11:37:57.318015+0000","last_fullsized":"2024-06-13T11:37:57.318015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:14:01.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318807+0000","last_change":"2024-06-13T11:37:56.313649+0000","last_active":"2024-06-13T11:37:57.318807+0000","last_peered":"2024-06-13T11:37:57.318807+0000","last_clean":"2024-06-13T11:37:57.318807+0000","last_became_active":"2024-06-13T11:37:56.313376+0000","last_became_peered":"2024-06-13T11:37:56.313376+0000","last_unstale":"2024-06-13T11:37:57.318807+0000","last_undegraded":"2024-06-13T11:37:57.318807+0000","last_fullsized":"2024-06-13T11:37:57.318807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:54:32.345878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460129+0000","last_change":"2024-06-13T11:37:55.315779+0000","last_active":"2024-06-13T11:37:57.460129+0000","last_peered":"2024-06-13T11:37:57.460129+0000","last_clean":"2024-06-13T11:37:57.460129+0000","last_became_active":"2024-06-13T11:37:55.315487+0000","last_became_peered":"2024-06-13T11:37:55.315487+0000","last_unstale":"2024-06-13T11:37:57.460129+0000","last_undegraded":"2024-06-13T11:37:57.460129+0000","last_fullsized":"2024-06-13T11:37:57.460129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:27:23.548608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060882+0000","last_change":"2024-06-13T11:37:56.332594+0000","last_active":"2024-06-13T11:37:58.060882+0000","last_peered":"2024-06-13T11:37:58.060882+0000","last_clean":"2024-06-13T11:37:58.060882+0000","last_became_active":"2024-06-13T11:37:56.332265+0000","last_became_peered":"2024-06-13T11:37:56.332265+0000","last_unstale":"2024-06-13T11:37:58.060882+0000","last_undegraded":"2024-06-13T11:37:58.060882+0000","last_fullsized":"2024-06-13T11:37:58.060882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:15:14.354967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.317910+0000","last_change":"2024-06-13T11:37:55.314354+0000","last_active":"2024-06-13T11:37:57.317910+0000","last_peered":"2024-06-13T11:37:57.317910+0000","last_clean":"2024-06-13T11:37:57.317910+0000","last_became_active":"2024-06-13T11:37:55.314034+0000","last_became_peered":"2024-06-13T11:37:55.314034+0000","last_unstale":"2024-06-13T11:37:57.317910+0000","last_undegraded":"2024-06-13T11:37:57.317910+0000","last_fullsized":"2024-06-13T11:37:57.317910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:29.902564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087663+0000","last_change":"2024-06-13T11:37:56.318282+0000","last_active":"2024-06-13T11:37:58.087663+0000","last_peered":"2024-06-13T11:37:58.087663+0000","last_clean":"2024-06-13T11:37:58.087663+0000","last_became_active":"2024-06-13T11:37:56.317985+0000","last_became_peered":"2024-06-13T11:37:56.317985+0000","last_unstale":"2024-06-13T11:37:58.087663+0000","last_undegraded":"2024-06-13T11:37:58.087663+0000","last_fullsized":"2024-06-13T11:37:58.087663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:58:30.751860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320616+0000","last_change":"2024-06-13T11:37:55.313951+0000","last_active":"2024-06-13T11:37:57.320616+0000","last_peered":"2024-06-13T11:37:57.320616+0000","last_clean":"2024-06-13T11:37:57.320616+0000","last_became_active":"2024-06-13T11:37:55.313509+0000","last_became_peered":"2024-06-13T11:37:55.313509+0000","last_unstale":"2024-06-13T11:37:57.320616+0000","last_undegraded":"2024-06-13T11:37:57.320616+0000","last_fullsized":"2024-06-13T11:37:57.320616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:25:26.188457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460535+0000","last_change":"2024-06-13T11:37:56.333448+0000","last_active":"2024-06-13T11:37:57.460535+0000","last_peered":"2024-06-13T11:37:57.460535+0000","last_clean":"2024-06-13T11:37:57.460535+0000","last_became_active":"2024-06-13T11:37:56.332703+0000","last_became_peered":"2024-06-13T11:37:56.332703+0000","last_unstale":"2024-06-13T11:37:57.460535+0000","last_undegraded":"2024-06-13T11:37:57.460535+0000","last_fullsized":"2024-06-13T11:37:57.460535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:00:30.487877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.318120+0000","last_change":"2024-06-13T11:37:55.310716+0000","last_active":"2024-06-13T11:37:57.318120+0000","last_peered":"2024-06-13T11:37:57.318120+0000","last_clean":"2024-06-13T11:37:57.318120+0000","last_became_active":"2024-06-13T11:37:55.310423+0000","last_became_peered":"2024-06-13T11:37:55.310423+0000","last_unstale":"2024-06-13T11:37:57.318120+0000","last_undegraded":"2024-06-13T11:37:57.318120+0000","last_fullsized":"2024-06-13T11:37:57.318120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:17:20.099417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060866+0000","last_change":"2024-06-13T11:37:56.323367+0000","last_active":"2024-06-13T11:37:58.060866+0000","last_peered":"2024-06-13T11:37:58.060866+0000","last_clean":"2024-06-13T11:37:58.060866+0000","last_became_active":"2024-06-13T11:37:56.323061+0000","last_became_peered":"2024-06-13T11:37:56.323061+0000","last_unstale":"2024-06-13T11:37:58.060866+0000","last_undegraded":"2024-06-13T11:37:58.060866+0000","last_fullsized":"2024-06-13T11:37:58.060866+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:54:53.136453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087205+0000","last_change":"2024-06-13T11:37:55.316693+0000","last_active":"2024-06-13T11:37:58.087205+0000","last_peered":"2024-06-13T11:37:58.087205+0000","last_clean":"2024-06-13T11:37:58.087205+0000","last_became_active":"2024-06-13T11:37:55.316352+0000","last_became_peered":"2024-06-13T11:37:55.316352+0000","last_unstale":"2024-06-13T11:37:58.087205+0000","last_undegraded":"2024-06-13T11:37:58.087205+0000","last_fullsized":"2024-06-13T11:37:58.087205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:30:29.357875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087131+0000","last_change":"2024-06-13T11:37:56.330835+0000","last_active":"2024-06-13T11:37:58.087131+0000","last_peered":"2024-06-13T11:37:58.087131+0000","last_clean":"2024-06-13T11:37:58.087131+0000","last_became_active":"2024-06-13T11:37:56.330558+0000","last_became_peered":"2024-06-13T11:37:56.330558+0000","last_unstale":"2024-06-13T11:37:58.087131+0000","last_undegraded":"2024-06-13T11:37:58.087131+0000","last_fullsized":"2024-06-13T11:37:58.087131+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:14:31.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087393+0000","last_change":"2024-06-13T11:37:55.317955+0000","last_active":"2024-06-13T11:37:58.087393+0000","last_peered":"2024-06-13T11:37:58.087393+0000","last_clean":"2024-06-13T11:37:58.087393+0000","last_became_active":"2024-06-13T11:37:55.317670+0000","last_became_peered":"2024-06-13T11:37:55.317670+0000","last_unstale":"2024-06-13T11:37:58.087393+0000","last_undegraded":"2024-06-13T11:37:58.087393+0000","last_fullsized":"2024-06-13T11:37:58.087393+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:49.054318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087628+0000","last_change":"2024-06-13T11:37:56.327970+0000","last_active":"2024-06-13T11:37:58.087628+0000","last_peered":"2024-06-13T11:37:58.087628+0000","last_clean":"2024-06-13T11:37:58.087628+0000","last_became_active":"2024-06-13T11:37:56.327680+0000","last_became_peered":"2024-06-13T11:37:56.327680+0000","last_unstale":"2024-06-13T11:37:58.087628+0000","last_undegraded":"2024-06-13T11:37:58.087628+0000","last_fullsized":"2024-06-13T11:37:58.087628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:14:31.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.319495+0000","last_change":"2024-06-13T11:37:55.316251+0000","last_active":"2024-06-13T11:37:57.319495+0000","last_peered":"2024-06-13T11:37:57.319495+0000","last_clean":"2024-06-13T11:37:57.319495+0000","last_became_active":"2024-06-13T11:37:55.315016+0000","last_became_peered":"2024-06-13T11:37:55.315016+0000","last_unstale":"2024-06-13T11:37:57.319495+0000","last_undegraded":"2024-06-13T11:37:57.319495+0000","last_fullsized":"2024-06-13T11:37:57.319495+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:33.662473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.087017+0000","last_change":"2024-06-13T11:37:56.325514+0000","last_active":"2024-06-13T11:37:58.087017+0000","last_peered":"2024-06-13T11:37:58.087017+0000","last_clean":"2024-06-13T11:37:58.087017+0000","last_became_active":"2024-06-13T11:37:56.324920+0000","last_became_peered":"2024-06-13T11:37:56.324920+0000","last_unstale":"2024-06-13T11:37:58.087017+0000","last_undegraded":"2024-06-13T11:37:58.087017+0000","last_fullsized":"2024-06-13T11:37:58.087017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:38:46.544540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.086454+0000","last_change":"2024-06-13T11:37:55.308637+0000","last_active":"2024-06-13T11:37:58.086454+0000","last_peered":"2024-06-13T11:37:58.086454+0000","last_clean":"2024-06-13T11:37:58.086454+0000","last_became_active":"2024-06-13T11:37:55.308361+0000","last_became_peered":"2024-06-13T11:37:55.308361+0000","last_unstale":"2024-06-13T11:37:58.086454+0000","last_undegraded":"2024-06-13T11:37:58.086454+0000","last_fullsized":"2024-06-13T11:37:58.086454+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:35:48.429691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460285+0000","last_change":"2024-06-13T11:37:56.332842+0000","last_active":"2024-06-13T11:37:57.460285+0000","last_peered":"2024-06-13T11:37:57.460285+0000","last_clean":"2024-06-13T11:37:57.460285+0000","last_became_active":"2024-06-13T11:37:56.332557+0000","last_became_peered":"2024-06-13T11:37:56.332557+0000","last_unstale":"2024-06-13T11:37:57.460285+0000","last_undegraded":"2024-06-13T11:37:57.460285+0000","last_fullsized":"2024-06-13T11:37:57.460285+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:32:45.975185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:58.060437+0000","last_change":"2024-06-13T11:37:55.315564+0000","last_active":"2024-06-13T11:37:58.060437+0000","last_peered":"2024-06-13T11:37:58.060437+0000","last_clean":"2024-06-13T11:37:58.060437+0000","last_became_active":"2024-06-13T11:37:55.313545+0000","last_became_peered":"2024-06-13T11:37:55.313545+0000","last_unstale":"2024-06-13T11:37:58.060437+0000","last_undegraded":"2024-06-13T11:37:58.060437+0000","last_fullsized":"2024-06-13T11:37:58.060437+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:03:46.960127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.320473+0000","last_change":"2024-06-13T11:37:56.319494+0000","last_active":"2024-06-13T11:37:57.320473+0000","last_peered":"2024-06-13T11:37:57.320473+0000","last_clean":"2024-06-13T11:37:57.320473+0000","last_became_active":"2024-06-13T11:37:56.319182+0000","last_became_peered":"2024-06-13T11:37:56.319182+0000","last_unstale":"2024-06-13T11:37:57.320473+0000","last_undegraded":"2024-06-13T11:37:57.320473+0000","last_fullsized":"2024-06-13T11:37:57.320473+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:55.292803+0000","last_clean_scrub_stamp":"2024-06-13T11:37:55.292803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.487698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460430+0000","last_change":"2024-06-13T11:37:55.318759+0000","last_active":"2024-06-13T11:37:57.460430+0000","last_peered":"2024-06-13T11:37:57.460430+0000","last_clean":"2024-06-13T11:37:57.460430+0000","last_became_active":"2024-06-13T11:37:55.318420+0000","last_became_peered":"2024-06-13T11:37:55.318420+0000","last_unstale":"2024-06-13T11:37:57.460430+0000","last_undegraded":"2024-06-13T11:37:57.460430+0000","last_fullsized":"2024-06-13T11:37:57.460430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:54.287887+0000","last_clean_scrub_stamp":"2024-06-13T11:37:54.287887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:20:21.172360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-06-13T11:37:57.460191+0000","last_change":"2024-06-13T11:37:03.238839+0000","last_active":"2024-06-13T11:37:57.460191+0000","last_peered":"2024-06-13T11:37:57.460191+0000","last_clean":"2024-06-13T11:37:57.460191+0000","last_became_active":"2024-06-13T11:37:03.237978+0000","last_became_peered":"2024-06-13T11:37:03.237978+0000","last_unstale":"2024-06-13T11:37:57.460191+0000","last_undegraded":"2024-06-13T11:37:57.460191+0000","last_fullsized":"2024-06-13T11:37:57.460191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:37:01.760832+0000","last_clean_scrub_stamp":"2024-06-13T11:37:01.760832+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:28:13.846019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1032192,"data_stored":770796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":178858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":179350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":438272,"data_stored":180392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":178816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":178836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":769148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":179328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:38:05.139 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-13T11:38:05.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-13T11:38:05.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.287+0000 7f7295293640 1 Processor -- start 2024-06-13T11:38:05.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.287+0000 7f7295293640 1 -- start start 2024-06-13T11:38:05.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f7295293640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72901455a0 0x7f7290071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f7295293640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290072040 0x7f72900cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f7295293640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7290160b20 0x7f72900cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f7295293640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f7290072810 con 0x7f7290160b20 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f7295293640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7290072530 con 0x7f72901455a0 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f7295293640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7290160040 con 0x7f7290072040 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7290160b20 0x7f72900cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7290160b20 0x7f72900cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51086/0 (socket says 172.21.15.43:51086) 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 -- 172.21.15.43:0/854295044 learned_addr learned my addr 172.21.15.43:0/854295044 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728e7fc640 1 --2- 172.21.15.43:0/854295044 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290072040 0x7f72900cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728effd640 1 --2- 172.21.15.43:0/854295044 >> v2:172.21.15.53:3300/0 conn(0x7f72901455a0 0x7f7290071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 -- 172.21.15.43:0/854295044 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290072040 msgr2=0x7f72900cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 --2- 172.21.15.43:0/854295044 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290072040 0x7f72900cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 -- 172.21.15.43:0/854295044 >> v2:172.21.15.53:3300/0 conn(0x7f72901455a0 msgr2=0x7f7290071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:05.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 --2- 172.21.15.43:0/854295044 >> v2:172.21.15.53:3300/0 conn(0x7f72901455a0 0x7f7290071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.288+0000 7f728f7fe640 1 -- 172.21.15.43:0/854295044 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7290160320 con 0x7f7290160b20 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.289+0000 7f728f7fe640 1 --2- 172.21.15.43:0/854295044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290160b20 0x7f72900cfc20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f72900b3c50 tx=0x7f728002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3201a17d4ade3a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.289+0000 7f728dffb640 1 -- 172.21.15.43:0/854295044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280036070 con 0x7f7290160b20 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.289+0000 7f728dffb640 1 -- 172.21.15.43:0/854295044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280031600 con 0x7f7290160b20 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.289+0000 7f728dffb640 1 -- 172.21.15.43:0/854295044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72800319d0 con 0x7f7290160b20 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 -- 172.21.15.43:0/854295044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290160b20 msgr2=0x7f72900cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 --2- 172.21.15.43:0/854295044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290160b20 0x7f72900cfc20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f72900b3c50 tx=0x7f728002a6a0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 -- 172.21.15.43:0/854295044 shutdown_connections 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 --2- 172.21.15.43:0/854295044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290160b20 0x7f72900cfc20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 --2- 172.21.15.43:0/854295044 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290072040 0x7f72900cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 --2- 172.21.15.43:0/854295044 >> v2:172.21.15.53:3300/0 conn(0x7f72901455a0 0x7f7290071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 -- 172.21.15.43:0/854295044 >> 172.21.15.43:0/854295044 conn(0x7f72900b1640 msgr2=0x7f72900b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 -- 172.21.15.43:0/854295044 shutdown_connections 2024-06-13T11:38:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.290+0000 7f7295293640 1 -- 172.21.15.43:0/854295044 wait complete. 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.291+0000 7f7295293640 1 Processor -- start 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.291+0000 7f7295293640 1 -- start start 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f7295293640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 0x7f729006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f7295293640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901455a0 0x7f7290141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f7295293640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290160b20 0x7f7290142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f7295293640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7290145b00 con 0x7f7290072040 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f7295293640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7290145980 con 0x7f72901455a0 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f7295293640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f7290145e60 con 0x7f7290160b20 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 0x7f729006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 0x7f729006e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51102/0 (socket says 172.21.15.43:51102) 2024-06-13T11:38:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728effd640 1 -- 172.21.15.43:0/414922795 learned_addr learned my addr 172.21.15.43:0/414922795 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728e7fc640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901455a0 0x7f7290141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728f7fe640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290160b20 0x7f7290142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728effd640 1 -- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290160b20 msgr2=0x7f7290142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.292+0000 7f728effd640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290160b20 0x7f7290142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f728effd640 1 -- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901455a0 msgr2=0x7f7290141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f728effd640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901455a0 0x7f7290141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f728effd640 1 -- 172.21.15.43:0/414922795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729006eef0 con 0x7f7290072040 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f728effd640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 0x7f729006e9b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f728800e9b0 tx=0x7f728800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288017070 con 0x7f7290072040 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728800c9a0 con 0x7f7290072040 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7290154080 con 0x7f7290072040 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728800cd90 con 0x7f7290072040 2024-06-13T11:38:05.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.293+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72901413d0 con 0x7f7290072040 2024-06-13T11:38:05.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.294+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72900688c0 con 0x7f7290072040 2024-06-13T11:38:05.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.294+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f728801a070 con 0x7f7290072040 2024-06-13T11:38:05.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.295+0000 7f72877fe640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f727006be60 0x7f727006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.295+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f728808b2c0 con 0x7f7290072040 2024-06-13T11:38:05.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.295+0000 7f728e7fc640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f727006be60 0x7f727006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.295+0000 7f728e7fc640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f727006be60 0x7f727006e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7290154450 tx=0x7f7278009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:05.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.299+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7288059490 con 0x7f7290072040 2024-06-13T11:38:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.554+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f72900a9810 con 0x7f7290072040 2024-06-13T11:38:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.556+0000 7f72877fe640 1 -- 172.21.15.43:0/414922795 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f728805d790 con 0x7f7290072040 2024-06-13T11:38:05.556 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-06-13T11:38:05.556 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCw2WpmIeYsHxAA/BvB+aniAfk6a2V9mayvuw== 2024-06-13T11:38:05.556 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2024-06-13T11:38:05.556 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2024-06-13T11:38:05.556 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-13T11:38:05.556 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2024-06-13T11:38:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f727006be60 msgr2=0x7f727006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f727006be60 0x7f727006e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7290154450 tx=0x7f7278009190 comp rx=0 tx=0).stop 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 msgr2=0x7f729006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 0x7f729006e9b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f728800e9b0 tx=0x7f728800ee70 comp rx=0 tx=0).stop 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 shutdown_connections 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f727006be60 0x7f727006e320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f7290160b20 0x7f7290142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72901455a0 0x7f7290141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 --2- 172.21.15.43:0/414922795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7290072040 0x7f729006e9b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 >> 172.21.15.43:0/414922795 conn(0x7f72900b1640 msgr2=0x7f729015cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 shutdown_connections 2024-06-13T11:38:05.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.558+0000 7f7295293640 1 -- 172.21.15.43:0/414922795 wait complete. 2024-06-13T11:38:05.568 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-13T11:38:05.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 Processor -- start 2024-06-13T11:38:05.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 -- start start 2024-06-13T11:38:05.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9a40d2a90 0x7ff9a40d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9a40abe00 0x7ff9a40ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a40aa5d0 con 0x7ff9a4155420 2024-06-13T11:38:05.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a40d3440 con 0x7ff9a40abe00 2024-06-13T11:38:05.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.673+0000 7ff9aacb3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a40aeb90 con 0x7ff9a40d2a90 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9a40abe00 0x7ff9a40ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9a40abe00 0x7ff9a40ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51108/0 (socket says 172.21.15.43:51108) 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 -- 172.21.15.43:0/2563448326 learned_addr learned my addr 172.21.15.43:0/2563448326 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a3fff640 1 --2- 172.21.15.43:0/2563448326 >> v2:172.21.15.53:3300/0 conn(0x7ff9a40d2a90 0x7ff9a40d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 -- 172.21.15.43:0/2563448326 >> v2:172.21.15.53:3300/0 conn(0x7ff9a40d2a90 msgr2=0x7ff9a40d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 --2- 172.21.15.43:0/2563448326 >> v2:172.21.15.53:3300/0 conn(0x7ff9a40d2a90 0x7ff9a40d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 -- 172.21.15.43:0/2563448326 >> v1:172.21.15.53:6789/0 conn(0x7ff9a4155420 legacy=0x7ff9a40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a9250640 1 -- 172.21.15.43:0/2563448326 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4155800 con 0x7ff9a40abe00 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.674+0000 7ff9a3fff640 1 --2- 172.21.15.43:0/2563448326 >> v2:172.21.15.53:3300/0 conn(0x7ff9a40d2a90 0x7ff9a40d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9a9250640 1 --2- 172.21.15.43:0/2563448326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a40ac270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40ad470 tx=0x7ff99c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbd677224b302f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9a37fe640 1 -- 172.21.15.43:0/2563448326 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c036070 con 0x7ff9a40abe00 2024-06-13T11:38:05.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9a37fe640 1 -- 172.21.15.43:0/2563448326 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c031600 con 0x7ff9a40abe00 2024-06-13T11:38:05.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9a37fe640 1 -- 172.21.15.43:0/2563448326 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0319d0 con 0x7ff9a40abe00 2024-06-13T11:38:05.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9aacb3640 1 -- 172.21.15.43:0/2563448326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 msgr2=0x7ff9a40ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/2563448326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a40ac270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40ad470 tx=0x7ff99c02a6f0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9aacb3640 1 -- 172.21.15.43:0/2563448326 shutdown_connections 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/2563448326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a40ac270 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.675+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/2563448326 >> v2:172.21.15.53:3300/0 conn(0x7ff9a40d2a90 0x7ff9a40d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.676+0000 7ff9aacb3640 1 -- 172.21.15.43:0/2563448326 >> 172.21.15.43:0/2563448326 conn(0x7ff9a4067640 msgr2=0x7ff9a40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.676+0000 7ff9aacb3640 1 -- 172.21.15.43:0/2563448326 shutdown_connections 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.676+0000 7ff9aacb3640 1 -- 172.21.15.43:0/2563448326 wait complete. 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.677+0000 7ff9aacb3640 1 Processor -- start 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.677+0000 7ff9aacb3640 1 -- start start 2024-06-13T11:38:05.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a41479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9a40d2a90 0x7ff9a4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a4155420 0x7ff9a414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a40aae30 con 0x7ff9a40abe00 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a40aab50 con 0x7ff9a4155420 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a40ab110 con 0x7ff9a40d2a90 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a41479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a41479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51124/0 (socket says 172.21.15.43:51124) 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 -- 172.21.15.43:0/1640498491 learned_addr learned my addr 172.21.15.43:0/1640498491 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a3fff640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9a40d2a90 0x7ff9a4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a9250640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a4155420 0x7ff9a414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 -- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9a40d2a90 msgr2=0x7ff9a4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9a40d2a90 0x7ff9a4156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 -- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a4155420 msgr2=0x7ff9a414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a4155420 0x7ff9a414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 -- 172.21.15.43:0/1640498491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4149810 con 0x7ff9a40abe00 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a8a4f640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a41479b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff99800b3f0 tx=0x7ff99800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998015020 con 0x7ff9a40abe00 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff998011830 con 0x7ff9a40abe00 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998011c20 con 0x7ff9a40abe00 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.678+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a4149af0 con 0x7ff9a40abe00 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.679+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a414a0b0 con 0x7ff9a40abe00 2024-06-13T11:38:05.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.680+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a404ffb0 con 0x7ff9a40abe00 2024-06-13T11:38:05.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.680+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff998018020 con 0x7ff9a40abe00 2024-06-13T11:38:05.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.681+0000 7ff9a17fa640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff98806be30 0x7ff98806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:05.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.681+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff99808aaf0 con 0x7ff9a40abe00 2024-06-13T11:38:05.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.681+0000 7ff9a3fff640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff98806be30 0x7ff98806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:05.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.681+0000 7ff9a3fff640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff98806be30 0x7ff98806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40d3d20 tx=0x7ff990008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:05.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.685+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff99801f030 con 0x7ff9a40abe00 2024-06-13T11:38:05.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.905+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9a415e460 con 0x7ff9a40abe00 2024-06-13T11:38:05.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.906+0000 7ff9a17fa640 1 -- 172.21.15.43:0/1640498491 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7ff998058cc0 con 0x7ff9a40abe00 2024-06-13T11:38:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:05.905 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/1984751010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6835","nonce":1984751010},{"type":"v1","addr":"172.21.15.53:6837","nonce":1984751010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6834/1309249986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1309249986},{"type":"v1","addr":"172.21.15.43:6834","nonce":1309249986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3923577734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6833","nonce":3923577734},{"type":"v1","addr":"172.21.15.43:6835","nonce":3923577734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:37:55.673493+0000","modified":"2024-06-13T11:37:58.686046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6836/122622789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":122622789},{"type":"v1","addr":"172.21.15.53:6836","nonce":122622789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-06-13T11:38:05.905 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 18 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff98806be30 msgr2=0x7ff98806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff98806be30 0x7ff98806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40d3d20 tx=0x7ff990008040 comp rx=0 tx=0).stop 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 msgr2=0x7ff9a41479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a41479b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff99800b3f0 tx=0x7ff99800b8b0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 shutdown_connections 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff98806be30 0x7ff98806e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a4155420 0x7ff9a414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff9a40d2a90 0x7ff9a4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 --2- 172.21.15.43:0/1640498491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9a40abe00 0x7ff9a41479b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 >> 172.21.15.43:0/1640498491 conn(0x7ff9a4067640 msgr2=0x7ff9a4070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 shutdown_connections 2024-06-13T11:38:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:05.908+0000 7ff9aacb3640 1 -- 172.21.15.43:0/1640498491 wait complete. 2024-06-13T11:38:06.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-13T11:37:55.673493+0000', 'modified': '2024-06-13T11:37:58.686046+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4926}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4926': {'gid': 4926, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6836/122622789', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 122622789}, {'type': 'v1', 'addr': '172.21.15.53:6836', 'nonce': 122622789}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4926, 'qdb_cluster': [4926]} 2024-06-13T11:38:06.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-13T11:38:06.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-13T11:38:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.430+0000 7f9d7158b640 1 Processor -- start 2024-06-13T11:38:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.431+0000 7f9d7158b640 1 -- start start 2024-06-13T11:38:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.431+0000 7f9d7158b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 0x7f9d6c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.431+0000 7f9d7158b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c0cffc0 con 0x7f9d6c147480 2024-06-13T11:38:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.431+0000 7f9d7158b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c0d02a0 con 0x7f9d6c0cf850 2024-06-13T11:38:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.431+0000 7f9d7158b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6c071db0 con 0x7f9d6c0d1380 2024-06-13T11:38:06.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d6affd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9d6c147480 0x7f9d6c0d0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:56862/0 (socket says 172.21.15.43:56862) 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d6affd640 1 -- 172.21.15.43:0/73315261 learned_addr learned my addr 172.21.15.43:0/73315261 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 0x7f9d6c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861444016 0 0) 0x7f9d6c0cffc0 con 0x7f9d6c147480 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d58003520 con 0x7f9d6c147480 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.1 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869214994 0 0) 0x7f9d6c0d02a0 con 0x7f9d6c0cf850 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d6c0cffc0 con 0x7f9d6c0cf850 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3414849881 0 0) 0x7f9d58003520 con 0x7f9d6c147480 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 msgr2=0x7f9d6c147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 0x7f9d6c147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 >> v1:172.21.15.53:6789/0 conn(0x7f9d6c0cf850 legacy=0x7f9d6c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c071a40 con 0x7f9d6c147480 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1341197400 0 0) 0x7f9d64001670 con 0x7f9d6c147480 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 >> v1:172.21.15.43:6789/0 conn(0x7f9d6c147480 legacy=0x7f9d6c0d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 0x7f9d58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d58004d40 0x7f9d580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c071db0 con 0x7f9d58003b70 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5800ba70 con 0x7f9d58004d40 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5800bc70 con 0x7f9d6c0d1380 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d6affd640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 0x7f9d58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.432+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d58004d40 0x7f9d580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6affd640 1 -- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 msgr2=0x7f9d58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6affd640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c0d1380 0x7f9d58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6affd640 1 -- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d58004d40 msgr2=0x7f9d580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6affd640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d58004d40 0x7f9d580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6affd640 1 -- 172.21.15.43:0/73315261 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d58003520 con 0x7f9d58003b70 2024-06-13T11:38:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d58004d40 0x7f9d580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.433+0000 7f9d6affd640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d58003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400c0e0 tx=0x7f9d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ad4af63b7634db server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64007c40 con 0x7f9d58003b70 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d64005ad0 con 0x7f9d58003b70 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d69ffb640 1 -- 172.21.15.43:0/73315261 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64007070 con 0x7f9d58003b70 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d7158b640 1 -- 172.21.15.43:0/73315261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 msgr2=0x7f9d58003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d7158b640 1 --2- 172.21.15.43:0/73315261 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d58003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400c0e0 tx=0x7f9d58005830 comp rx=0 tx=0).stop 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d6b7fe640 1 -- 172.21.15.43:0/73315261 reap_dead start 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d7158b640 1 -- 172.21.15.43:0/73315261 shutdown_connections 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d7158b640 1 -- 172.21.15.43:0/73315261 >> 172.21.15.43:0/73315261 conn(0x7f9d6c070810 msgr2=0x7f9d6c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d7158b640 1 -- 172.21.15.43:0/73315261 shutdown_connections 2024-06-13T11:38:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.434+0000 7f9d7158b640 1 -- 172.21.15.43:0/73315261 wait complete. 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.435+0000 7f9d7158b640 1 Processor -- start 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 -- start start 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d6c0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d6c1504f0 0x7f9d6c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c161d70 0x7f9d6c1621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c147dc0 con 0x7f9d58003b70 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c0ae340 con 0x7f9d6c1504f0 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d7158b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6c147f40 con 0x7f9d6c161d70 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d6c0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d6c0cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51146/0 (socket says 172.21.15.43:51146) 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.436+0000 7f9d6affd640 1 -- 172.21.15.43:0/1404696190 learned_addr learned my addr 172.21.15.43:0/1404696190 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d6c1504f0 0x7f9d6c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c161d70 0x7f9d6c1621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6affd640 1 -- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c161d70 msgr2=0x7f9d6c1621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6affd640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c161d70 0x7f9d6c1621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6affd640 1 -- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d6c1504f0 msgr2=0x7f9d6c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6affd640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d6c1504f0 0x7f9d6c144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6affd640 1 -- 172.21.15.43:0/1404696190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c162730 con 0x7f9d58003b70 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d6c1504f0 0x7f9d6c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d6affd640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d6c0cf120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400c0e0 tx=0x7f9d64001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d637fe640 1 -- 172.21.15.43:0/1404696190 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64001670 con 0x7f9d58003b70 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d637fe640 1 -- 172.21.15.43:0/1404696190 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d64042070 con 0x7f9d58003b70 2024-06-13T11:38:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d637fe640 1 -- 172.21.15.43:0/1404696190 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d640072b0 con 0x7f9d58003b70 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6c1453e0 con 0x7f9d58003b70 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.437+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6c1459a0 con 0x7f9d58003b70 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.438+0000 7f9d637fe640 1 -- 172.21.15.43:0/1404696190 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d64007450 con 0x7f9d58003b70 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.439+0000 7f9d637fe640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9d4c06be30 0x7f9d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.439+0000 7f9d637fe640 1 -- 172.21.15.43:0/1404696190 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f9d640aaf30 con 0x7f9d58003b70 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.439+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9d4c06be30 0x7f9d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.440+0000 7f9d74370740 1 Processor -- start 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.440+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9d4c06be30 0x7f9d4c06e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c15f320 tx=0x7f9d54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.440+0000 7f9d74370740 1 -- start start 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d74370740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640dca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640ac990 0x55bf640b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d74370740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf64015740 con 0x55bf640da110 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf63fb3a80 con 0x55bf640d9d30 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x55bf64011700 con 0x55bf640ac990 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640dca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640dca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51152/0 (socket says 172.21.15.43:51152) 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/3769804079 learned_addr learned my addr 172.21.15.43:0/3769804079 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6affd640 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640ac990 0x55bf640b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640ac990 msgr2=0x55bf640b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640ac990 0x55bf640b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 msgr2=0x55bf640dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640dc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/3769804079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf63fdefb0 con 0x55bf640da110 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640dca80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9d54013e10 tx=0x7f9d54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfde0da75742542 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.441+0000 7f9d60ff9640 1 -- 172.21.15.43:0/3769804079 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54016db0 con 0x55bf640da110 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d60ff9640 1 -- 172.21.15.43:0/3769804079 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d54028070 con 0x55bf640da110 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d60ff9640 1 -- 172.21.15.43:0/3769804079 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54023660 con 0x55bf640da110 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 -- 172.21.15.43:0/3769804079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 msgr2=0x55bf640dca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640dca80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9d54013e10 tx=0x7f9d54016000 comp rx=0 tx=0).stop 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 -- 172.21.15.43:0/3769804079 shutdown_connections 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640ac990 0x55bf640b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640dca80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 --2- 172.21.15.43:0/3769804079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640dc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 -- 172.21.15.43:0/3769804079 >> 172.21.15.43:0/3769804079 conn(0x55bf640aec00 msgr2=0x55bf640f7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 -- 172.21.15.43:0/3769804079 shutdown_connections 2024-06-13T11:38:06.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.442+0000 7f9d74370740 1 -- 172.21.15.43:0/3769804079 wait complete. 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.443+0000 7f9d74370740 1 -- start start 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.443+0000 7f9d74370740 1 Processor -- start 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf640fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 0x55bf640b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf640b1db0 con 0x55bf640fac30 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf63f9ec30 con 0x55bf640d9d30 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x55bf640b2090 con 0x55bf640da110 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d74370740 10 client.0 _ll_register_callbacks cb 0x55bf63fd07f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 0x55bf640b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 0x55bf640b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51168/0 (socket says 172.21.15.43:51168) 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 -- 172.21.15.43:0/1337641758 learned_addr learned my addr 172.21.15.43:0/1337641758 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6affd640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf640fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 -- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 msgr2=0x55bf640fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf640fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 -- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 msgr2=0x55bf640d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 -- 172.21.15.43:0/1337641758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf63d292d0 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 0x55bf640b11b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c012560 tx=0x7f9d5c012a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513a44d64c13036c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.444+0000 7f9d49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d49ffb640 1 -- 172.21.15.43:0/1337641758 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c019020 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d49ffb640 1 -- 172.21.15.43:0/1337641758 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f9d5c003b80 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d54028070 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d49ffb640 1 -- 172.21.15.43:0/1337641758 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9d5c023050 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 10 client.5115 fetch_fsmap learned FSMap version 18 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55bf63df36b0 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d49ffb640 1 -- 172.21.15.43:0/1337641758 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d54028070 con 0x55bf640fac30 2024-06-13T11:38:06.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d49ffb640 1 -- 172.21.15.43:0/1337641758 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f9d5c026020 con 0x55bf640fac30 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 10 client.5115 fetch_fsmap finished waiting for FSMap version 18 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 10 client.5115 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 20 client.5115 populate_metadata read hostname 'smithi043' 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f21c0 0x55bf640de530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 4 client.5115 mds_command: new command op to 4926 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 --> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf64022e70 con 0x55bf640f21c0 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.445+0000 7f9d6affd640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f21c0 0x55bf640de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.446+0000 7f9d6affd640 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f21c0 0x55bf640de530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ade48aee389af2 server_cookie=6e2a23a8e86f8319 in_seq=0 out_seq=0 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.446+0000 7f9d49ffb640 10 client.5115 ms_handle_connect on v2:172.21.15.53:6834/122622789 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d49ffb640 1 -- 172.21.15.43:0/1337641758 <== mds.0 v2:172.21.15.53:6834/122622789 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bf64022e70 con 0x55bf640f21c0 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d49ffb640 10 client.5115 handle_command_reply: tid=0 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 client.5115 shutdown 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 msgr2=0x55bf640b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 0x55bf640b11b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c012560 tx=0x7f9d5c012a20 comp rx=0 tx=0).stop 2024-06-13T11:38:06.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 shutdown_connections 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f21c0 0x55bf640de530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640fac30 0x55bf640b11b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf640fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 --2- 172.21.15.43:0/1337641758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640d9d30 0x55bf640d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d49ffb640 0 client.5115 ms_handle_reset on v2:172.21.15.53:6834/122622789 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 >> 172.21.15.43:0/1337641758 conn(0x55bf640ac990 msgr2=0x55bf640d9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 shutdown_connections 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 1 -- 172.21.15.43:0/1337641758 wait complete. 2024-06-13T11:38:06.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.447+0000 7f9d74370740 20 client.5115 trim_cache size 0 max 16384 2024-06-13T11:38:06.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.466+0000 7f9d74370740 1 Processor -- start 2024-06-13T11:38:06.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.466+0000 7f9d74370740 1 -- start start 2024-06-13T11:38:06.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640d9d30 0x55bf640f7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d74370740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d74370740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c200510 con 0x55bf640da110 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c14f290 con 0x55bf640fac30 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6c1ffec0 con 0x55bf640d9d30 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640de6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51184/0 (socket says 172.21.15.43:51184) 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/2128763888 learned_addr learned my addr 172.21.15.43:0/2128763888 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6affd640 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640d9d30 0x55bf640f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640d9d30 msgr2=0x55bf640f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640d9d30 0x55bf640f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 msgr2=0x55bf6411b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 -- 172.21.15.43:0/2128763888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf640ac4d0 con 0x55bf640da110 2024-06-13T11:38:06.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.467+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640de6a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9d540136b0 tx=0x7f9d5401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24ff1d6b3e013b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d4bfff640 1 -- 172.21.15.43:0/2128763888 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5403a070 con 0x55bf640da110 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d4bfff640 1 -- 172.21.15.43:0/2128763888 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d54028040 con 0x55bf640da110 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d4bfff640 1 -- 172.21.15.43:0/2128763888 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54016db0 con 0x55bf640da110 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 -- 172.21.15.43:0/2128763888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 msgr2=0x55bf640de6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640de6a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9d540136b0 tx=0x7f9d5401a000 comp rx=0 tx=0).stop 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 -- 172.21.15.43:0/2128763888 shutdown_connections 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640da110 0x55bf640de6a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 --2- 172.21.15.43:0/2128763888 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640d9d30 0x55bf640f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 -- 172.21.15.43:0/2128763888 >> 172.21.15.43:0/2128763888 conn(0x55bf640ac990 msgr2=0x55bf640f0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 -- 172.21.15.43:0/2128763888 shutdown_connections 2024-06-13T11:38:06.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.468+0000 7f9d74370740 1 -- 172.21.15.43:0/2128763888 wait complete. 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.469+0000 7f9d74370740 1 -- start start 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.469+0000 7f9d74370740 1 Processor -- start 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 0x55bf6416cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf64179900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf640f2040 con 0x55bf640d9d30 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bf640f3ca0 con 0x55bf640fac30 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x55bf640f2690 con 0x55bf640da110 2024-06-13T11:38:06.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 10 client.0 _ll_register_callbacks cb 0x7f9d5c002140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 0x55bf6416cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 0x55bf6416cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51198/0 (socket says 172.21.15.43:51198) 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 -- 172.21.15.43:0/2057678001 learned_addr learned my addr 172.21.15.43:0/2057678001 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6b7fe640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf64179900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 -- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 msgr2=0x55bf64179900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf64179900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 -- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 msgr2=0x55bf6411b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 -- 172.21.15.43:0/2057678001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf640f2c30 con 0x55bf640d9d30 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d6affd640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 0x55bf6416cce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9d64081790 tx=0x7f9d64079950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f3d7893dc96e8f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d49ffb640 1 -- 172.21.15.43:0/2057678001 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6407d490 con 0x55bf640d9d30 2024-06-13T11:38:06.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d49ffb640 1 -- 172.21.15.43:0/2057678001 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f9d640773e0 con 0x55bf640d9d30 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.470+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d54028040 con 0x55bf640d9d30 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d49ffb640 1 -- 172.21.15.43:0/2057678001 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9d64081cc0 con 0x55bf640d9d30 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 10 client.5121 fetch_fsmap learned FSMap version 18 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55bf640d96d0 con 0x55bf640d9d30 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d49ffb640 1 -- 172.21.15.43:0/2057678001 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d54028040 con 0x55bf640d9d30 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d49ffb640 1 -- 172.21.15.43:0/2057678001 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f9d64075750 con 0x55bf640d9d30 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 10 client.5121 fetch_fsmap finished waiting for FSMap version 18 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 10 client.5121 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 20 client.5121 populate_metadata read hostname 'smithi043' 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f9b40 0x55bf64110b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 4 client.5121 mds_command: new command op to 4926 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 --> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] -- command(tid 0: {"prefix": "status"}) -- 0x55bf6401d1c0 con 0x55bf640f9b40 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f9b40 0x55bf64110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d6a7fc640 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f9b40 0x55bf64110b20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f84fd5c6a195d49 server_cookie=9485a61e52a60435 in_seq=0 out_seq=0 2024-06-13T11:38:06.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.471+0000 7f9d49ffb640 10 client.5121 ms_handle_connect on v2:172.21.15.53:6834/122622789 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d49ffb640 1 -- 172.21.15.43:0/2057678001 <== mds.0 v2:172.21.15.53:6834/122622789 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55bf6401d1c0 con 0x55bf640f9b40 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d49ffb640 10 client.5121 handle_command_reply: tid=0 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 client.5121 shutdown 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 msgr2=0x55bf6416cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 0x55bf6416cce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9d64081790 tx=0x7f9d64079950 comp rx=0 tx=0).stop 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 shutdown_connections 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf640fac30 0x55bf6411b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x55bf640da110 0x55bf64179900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.53:6834/122622789,v1:172.21.15.53:6836/122622789] conn(0x55bf640f9b40 0x55bf64110b20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 --2- 172.21.15.43:0/2057678001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf640d9d30 0x55bf6416cce0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d49ffb640 0 client.5121 ms_handle_reset on v2:172.21.15.53:6834/122622789 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 >> 172.21.15.43:0/2057678001 conn(0x55bf640ac990 msgr2=0x55bf640f7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 shutdown_connections 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 1 -- 172.21.15.43:0/2057678001 wait complete. 2024-06-13T11:38:06.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d74370740 20 client.5121 trim_cache size 0 max 16384 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5", 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4926, 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 10.168366225, 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 18, 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 37, 2024-06-13T11:38:06.477 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 37, 2024-06-13T11:38:06.478 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 17.202197735999999 2024-06-13T11:38:06.478 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-06-13T11:38:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9d4c06be30 msgr2=0x7f9d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9d4c06be30 0x7f9d4c06e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c15f320 tx=0x7f9d54008040 comp rx=0 tx=0).stop 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 msgr2=0x7f9d6c0cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d6c0cf120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400c0e0 tx=0x7f9d64001970 comp rx=0 tx=0).stop 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 shutdown_connections 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f9d4c06be30 0x7f9d4c06e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f9d6c161d70 0x7f9d6c1621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d6c1504f0 0x7f9d6c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 --2- 172.21.15.43:0/1404696190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d58003b70 0x7f9d6c0cf120 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.472+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 >> 172.21.15.43:0/1404696190 conn(0x7f9d6c070810 msgr2=0x7f9d6c0d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.473+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 shutdown_connections 2024-06-13T11:38:06.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.473+0000 7f9d7158b640 1 -- 172.21.15.43:0/1404696190 wait complete. 2024-06-13T11:38:06.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-13T11:38:06.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.588+0000 7f54f619d640 1 Processor -- start 2024-06-13T11:38:06.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.588+0000 7f54f619d640 1 -- start start 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54f619d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54f619d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f54f006d840 0x7f54f0071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54f619d640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f00711f0 con 0x7f54f00721d0 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54f619d640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f54f0072f60 con 0x7f54f006d840 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54f619d640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f54f0071490 con 0x7f54f0155010 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54eeffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f54f006d840 0x7f54f0071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54effff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f54f00721d0 0x7f54f006e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:56864/0 (socket says 172.21.15.43:56864) 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54effff640 1 -- 172.21.15.43:0/4156181912 learned_addr learned my addr 172.21.15.43:0/4156181912 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54ef7fe640 1 --2- 172.21.15.43:0/4156181912 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54eeffd640 1 -- 172.21.15.43:0/4156181912 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 msgr2=0x7f54f015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:06.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54eeffd640 1 --2- 172.21.15.43:0/4156181912 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54eeffd640 1 -- 172.21.15.43:0/4156181912 >> v1:172.21.15.43:6789/0 conn(0x7f54f00721d0 legacy=0x7f54f006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54eeffd640 1 -- 172.21.15.43:0/4156181912 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f0071770 con 0x7f54f006d840 2024-06-13T11:38:06.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.589+0000 7f54ee7fc640 1 -- 172.21.15.43:0/4156181912 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845381849 0 0) 0x7f54f00711f0 con 0x7f54f00721d0 2024-06-13T11:38:06.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.590+0000 7f54eeffd640 1 --2- 172.21.15.43:0/4156181912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f0071c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f54e40097a0 tx=0x7f54e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c01988789aff80 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.590+0000 7f54ee7fc640 1 -- 172.21.15.43:0/4156181912 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4037070 con 0x7f54f006d840 2024-06-13T11:38:06.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.590+0000 7f54ee7fc640 1 -- 172.21.15.43:0/4156181912 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e4032440 con 0x7f54f006d840 2024-06-13T11:38:06.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.590+0000 7f54ee7fc640 1 -- 172.21.15.43:0/4156181912 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4032810 con 0x7f54f006d840 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 -- 172.21.15.43:0/4156181912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 msgr2=0x7f54f0071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 --2- 172.21.15.43:0/4156181912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f0071c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f54e40097a0 tx=0x7f54e402a180 comp rx=0 tx=0).stop 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 -- 172.21.15.43:0/4156181912 shutdown_connections 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 --2- 172.21.15.43:0/4156181912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f0071c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 --2- 172.21.15.43:0/4156181912 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 -- 172.21.15.43:0/4156181912 >> 172.21.15.43:0/4156181912 conn(0x7f54f00b21f0 msgr2=0x7f54f00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 -- 172.21.15.43:0/4156181912 shutdown_connections 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.591+0000 7f54f619d640 1 -- 172.21.15.43:0/4156181912 wait complete. 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.592+0000 7f54f619d640 1 Processor -- start 2024-06-13T11:38:06.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.592+0000 7f54f619d640 1 -- start start 2024-06-13T11:38:06.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54f619d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54f619d640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f0160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f013f140 0x7f54f0140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54f619d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f54f006e960 con 0x7f54f006d840 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54f619d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f54f0072c10 con 0x7f54f013f140 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54f619d640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f54f006eae0 con 0x7f54f0155010 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51218/0 (socket says 172.21.15.43:51218) 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 -- 172.21.15.43:0/1493591948 learned_addr learned my addr 172.21.15.43:0/1493591948 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54eeffd640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 -- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 msgr2=0x7f54f0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54effff640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f013f140 0x7f54f0140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f0160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 -- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f013f140 msgr2=0x7f54f0140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.593+0000 7f54ef7fe640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f013f140 0x7f54f0140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54ef7fe640 1 -- 172.21.15.43:0/1493591948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f013fa50 con 0x7f54f006d840 2024-06-13T11:38:06.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54eeffd640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54effff640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f013f140 0x7f54f0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54ef7fe640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f015e8b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f54e000e9b0 tx=0x7f54e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0017070 con 0x7f54f006d840 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e000c9a0 con 0x7f54f006d840 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f013fd30 con 0x7f54f006d840 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e000cd90 con 0x7f54f006d840 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.594+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f01402f0 con 0x7f54f006d840 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.595+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f00b4060 con 0x7f54f006d840 2024-06-13T11:38:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.595+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54e001a070 con 0x7f54f006d840 2024-06-13T11:38:06.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.596+0000 7f54d7fff640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f54dc06be60 0x7f54dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:06.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.596+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f54e008b3e0 con 0x7f54f006d840 2024-06-13T11:38:06.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.596+0000 7f54eeffd640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f54dc06be60 0x7f54dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:06.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.596+0000 7f54eeffd640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f54dc06be60 0x7f54dc06e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54e4034000 tx=0x7f54e402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:06.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.600+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f54f00b4060 con 0x7f54f006d840 2024-06-13T11:38:06.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.822+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f54f004ffb0 con 0x7f54f006d840 2024-06-13T11:38:06.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.823+0000 7f54d7fff640 1 -- 172.21.15.43:0/1493591948 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f54e0059b70 con 0x7f54f006d840 2024-06-13T11:38:06.822 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-13T11:38:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.824+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f54dc06be60 msgr2=0x7f54dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.824+0000 7f54f619d640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f54dc06be60 0x7f54dc06e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f54e4034000 tx=0x7f54e402e000 comp rx=0 tx=0).stop 2024-06-13T11:38:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.824+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 msgr2=0x7f54f015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:06.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.824+0000 7f54f619d640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f015e8b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f54e000e9b0 tx=0x7f54e000ee70 comp rx=0 tx=0).stop 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 shutdown_connections 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f54dc06be60 0x7f54dc06e320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54f013f140 0x7f54f0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f54f0155010 0x7f54f0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 --2- 172.21.15.43:0/1493591948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54f006d840 0x7f54f015e8b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 >> 172.21.15.43:0/1493591948 conn(0x7f54f00b21f0 msgr2=0x7f54f00b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 shutdown_connections 2024-06-13T11:38:06.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:06.825+0000 7f54f619d640 1 -- 172.21.15.43:0/1493591948 wait complete. 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:38:06.835 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:38:06.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:06.836 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-06-13T11:38:06.852 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:38:06.852 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:38:06.852 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-06-13T11:38:06.853 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 3a:47:4e:9e:6f:1a brd ff:ff:ff:ff:ff:ff 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::185d:cbff:fe91:5711/64 scope link 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 3a:47:4e:9e:6f:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T11:38:06.854 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::3847:4eff:fe9e:6f1a/64 scope link 2024-06-13T11:38:06.855 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.855 INFO:teuthology.orchestra.run.smithi043.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-13T11:38:06.855 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether be:41:06:19:b0:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-13T11:38:06.855 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::bc41:6ff:fe19:b0c5/64 scope link 2024-06-13T11:38:06.855 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:38:06.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:06.855 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:38:06.917 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-06-13T11:38:06.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:06.919 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-06-13T11:38:06.976 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-06-13T11:38:06.976 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:38:06.976 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:38:06.976 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:38:06.976 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:38:06.977 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:38:06.977 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-06-13T11:38:06.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:38:06.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:38:06.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:38:06.977 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-06-13T11:38:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:38:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:38:07.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:07.105 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-06-13T11:38:07.121 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-13T11:38:07.122 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-13T11:38:07.122 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:38:07.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:07.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-06-13T11:38:07.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:38:07.188 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-13T11:38:07.243 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:38:07.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:38:07.244 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-13T11:38:07.299 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-06-13T11:38:07.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:07.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:38:07.385 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:38:07.385 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:38:07.394 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-06-13T11:38:07.394 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-06-13T11:38:07.394 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.53:3300,172.21.15.53:3301" 2024-06-13T11:38:07.394 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5.cephfs=/ 2024-06-13T11:38:07.394 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.43:3300/172.21.15.53:3300/172.21.15.53:3301" will pass to kernel 2024-06-13T11:38:07.395 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-13T11:38:07.395 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-06-13T11:38:07.395 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T11:38:07.395 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T11:38:07.395 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T11:38:07.396 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T11:38:07.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:07.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-13T11:38:07.423 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:38:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:38:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:38:07.529 INFO:teuthology.orchestra.run.smithi043.stdout:client4739 2024-06-13T11:38:07.529 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:38:07.529 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:38:07.545 DEBUG:teuthology.orchestra.run.smithi043:> mktemp -d --suffix=xfstests-dev 2024-06-13T11:38:07.601 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.dHWHNRE83Nxfstests-dev 2024-06-13T11:38:07.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:07.602 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.dHWHNRE83Nxfstests-dev) 2024-06-13T11:38:07.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:07.670 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.dHWHNRE83Nxfstests-dev) 2024-06-13T11:38:07.729 INFO:teuthology.orchestra.run.smithi043.stderr:Cloning into '/tmp/tmp.dHWHNRE83Nxfstests-dev'... 2024-06-13T11:38:08.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:08.459 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-06-13T11:38:08.521 DEBUG:teuthology.orchestra.run.smithi043:> mktemp -d --suffix=test 2024-06-13T11:38:08.576 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.nZPIJ9BvOktest 2024-06-13T11:38:08.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:38:08.576 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-06-13T11:38:08.633 DEBUG:teuthology.orchestra.run.smithi043:> mktemp -d --suffix=scratch 2024-06-13T11:38:08.690 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:38:08.690 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9.stream". 2024-06-13T11:38:08.690 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-06-13T11:38:09.341 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:03:29 ago on Thu 13 Jun 2024 11:34:40 AM UTC. 2024-06-13T11:38:09.428 INFO:teuthology.orchestra.run.smithi043.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:38:09.429 INFO:teuthology.orchestra.run.smithi043.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T11:38:09.430 INFO:teuthology.orchestra.run.smithi043.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-06-13T11:38:09.431 INFO:teuthology.orchestra.run.smithi043.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-06-13T11:38:09.431 INFO:teuthology.orchestra.run.smithi043.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-06-13T11:38:09.433 INFO:teuthology.orchestra.run.smithi043.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-06-13T11:38:09.435 INFO:teuthology.orchestra.run.smithi043.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-06-13T11:38:09.436 INFO:teuthology.orchestra.run.smithi043.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-06-13T11:38:09.437 INFO:teuthology.orchestra.run.smithi043.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-06-13T11:38:09.440 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:38:09.440 INFO:teuthology.orchestra.run.smithi043.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-06-13T11:38:09.442 INFO:teuthology.orchestra.run.smithi043.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-06-13T11:38:09.443 INFO:teuthology.orchestra.run.smithi043.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T11:38:09.444 INFO:teuthology.orchestra.run.smithi043.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-06-13T11:38:09.445 INFO:teuthology.orchestra.run.smithi043.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-06-13T11:38:09.445 INFO:teuthology.orchestra.run.smithi043.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-06-13T11:38:09.446 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-06-13T11:38:09.447 INFO:teuthology.orchestra.run.smithi043.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-06-13T11:38:09.448 INFO:teuthology.orchestra.run.smithi043.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-06-13T11:38:09.450 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.4.0-1.el9.x86_64 is already installed. 2024-06-13T11:38:09.497 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-06-13T11:38:09.499 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-devel x86_64 5.14.0-457.el9 appstream 21 M 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: gdbm-libs x86_64 1:1.23-1.el9 baseos 56 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: libnbd x86_64 1.20.0-1.el9 appstream 170 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-06-13T11:38:09.500 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout:Install 17 Packages 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 1 Package 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:09.501 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 29 M 2024-06-13T11:38:09.502 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-06-13T11:38:10.234 INFO:teuthology.orchestra.run.smithi043.stdout:(1/18): fio-engine-http-3.35-1.el9.x86_64.rpm 117 kB/s | 18 kB 00:00 2024-06-13T11:38:10.267 INFO:teuthology.orchestra.run.smithi043.stdout:(2/18): rmt-1.6-6.el9.x86_64.rpm 245 kB/s | 46 kB 00:00 2024-06-13T11:38:10.309 INFO:teuthology.orchestra.run.smithi043.stdout:(3/18): fio-engine-libaio-3.35-1.el9.x86_64.rpm 207 kB/s | 16 kB 00:00 2024-06-13T11:38:10.334 INFO:teuthology.orchestra.run.smithi043.stdout:(4/18): fio-engine-nbd-3.35-1.el9.x86_64.rpm 218 kB/s | 15 kB 00:00 2024-06-13T11:38:10.368 INFO:teuthology.orchestra.run.smithi043.stdout:(5/18): fio-engine-rados-3.35-1.el9.x86_64.rpm 266 kB/s | 16 kB 00:00 2024-06-13T11:38:10.394 INFO:teuthology.orchestra.run.smithi043.stdout:(6/18): fio-engine-rbd-3.35-1.el9.x86_64.rpm 274 kB/s | 16 kB 00:00 2024-06-13T11:38:10.422 INFO:teuthology.orchestra.run.smithi043.stdout:(7/18): fio-engine-rdma-3.35-1.el9.x86_64.rpm 385 kB/s | 21 kB 00:00 2024-06-13T11:38:10.481 INFO:teuthology.orchestra.run.smithi043.stdout:(8/18): libcap-devel-2.48-9.el9.x86_64.rpm 697 kB/s | 41 kB 00:00 2024-06-13T11:38:10.590 INFO:teuthology.orchestra.run.smithi043.stdout:(9/18): libnbd-1.20.0-1.el9.x86_64.rpm 1.5 MB/s | 170 kB 00:00 2024-06-13T11:38:10.690 INFO:teuthology.orchestra.run.smithi043.stdout:(10/18): sqlite-3.34.1-7.el9.x86_64.rpm 7.3 MB/s | 748 kB 00:00 2024-06-13T11:38:10.774 INFO:teuthology.orchestra.run.smithi043.stdout:(11/18): udftools-2.2-5.el9.x86_64.rpm 1.8 MB/s | 149 kB 00:00 2024-06-13T11:38:11.532 INFO:teuthology.orchestra.run.smithi043.stdout:(12/18): gdbm-1.23-1.el9.x86_64.rpm 202 kB/s | 153 kB 00:00 2024-06-13T11:38:11.908 INFO:teuthology.orchestra.run.smithi043.stdout:(13/18): fio-3.35-1.el9.x86_64.rpm 3.4 MB/s | 6.2 MB 00:01 2024-06-13T11:38:11.967 INFO:teuthology.orchestra.run.smithi043.stdout:(14/18): dump-0.4-0.51.b47.el9.x86_64.rpm 1.5 MB/s | 88 kB 00:00 2024-06-13T11:38:11.992 INFO:teuthology.orchestra.run.smithi043.stdout:(15/18): indent-2.2.13-5.el9.x86_64.rpm 7.0 MB/s | 179 kB 00:00 2024-06-13T11:38:12.026 INFO:teuthology.orchestra.run.smithi043.stdout:(16/18): gdbm-libs-1.23-1.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-06-13T11:38:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:(17/18): gdbm-devel-1.23-1.el9.x86_64.rpm 107 kB/s | 81 kB 00:00 2024-06-13T11:38:13.326 INFO:teuthology.orchestra.run.smithi043.stdout:(18/18): kernel-devel-5.14.0-457.el9.x86_64.rpm 7.1 MB/s | 21 MB 00:02 2024-06-13T11:38:13.327 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:38:13.328 INFO:teuthology.orchestra.run.smithi043.stdout:Total 7.5 MB/s | 29 MB 00:03 2024-06-13T11:38:13.697 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-06-13T11:38:13.754 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:38:13.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:38:13.766 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-06-13T11:38:13.766 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-06-13T11:38:14.372 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-06-13T11:38:14.372 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-06-13T11:38:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-06-13T11:38:15.578 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : gdbm-libs-1:1.23-1.el9.x86_64 1/19 2024-06-13T11:38:15.628 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 2/19 2024-06-13T11:38:15.659 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libnbd-1.20.0-1.el9.x86_64 3/19 2024-06-13T11:38:15.692 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 4/19 2024-06-13T11:38:15.718 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 5/19 2024-06-13T11:38:15.743 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 6/19 2024-06-13T11:38:15.768 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 7/19 2024-06-13T11:38:15.794 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 8/19 2024-06-13T11:38:15.953 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 9/19 2024-06-13T11:38:16.000 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fio-3.35-1.el9.x86_64 10/19 2024-06-13T11:38:16.035 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rmt-2:1.6-6.el9.x86_64 11/19 2024-06-13T11:38:16.066 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 12/19 2024-06-13T11:38:16.110 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 13/19 2024-06-13T11:38:16.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : indent-2.2.13-5.el9.x86_64 14/19 2024-06-13T11:38:16.192 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : udftools-2.2-5.el9.x86_64 15/19 2024-06-13T11:38:16.243 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 16/19 2024-06-13T11:38:26.336 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 17/19 2024-06-13T11:38:26.549 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-devel-5.14.0-457.el9.x86_64 18/19 2024-06-13T11:38:37.954 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-devel-5.14.0-457.el9.x86_64 18/19 2024-06-13T11:38:38.029 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-3.35-1.el9.x86_64 2/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/19 2024-06-13T11:38:40.042 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-devel-5.14.0-457.el9.x86_64 9/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libnbd-1.20.0-1.el9.x86_64 11/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 14/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 15/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/19 2024-06-13T11:38:40.043 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gdbm-libs-1:1.23-1.el9.x86_64 18/19 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout: gdbm-libs-1:1.23-1.el9.x86_64 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-06-13T11:38:40.593 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-457.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.20.0-1.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: udftools-2.2-5.el9.x86_64 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:40.594 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-06-13T11:38:41.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo useradd -m fsgqa 2024-06-13T11:38:41.063 INFO:teuthology.orchestra.run.smithi043.stderr:useradd: user 'fsgqa' already exists 2024-06-13T11:38:41.065 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-06-13T11:38:41.065 DEBUG:teuthology.orchestra.run.smithi043:> sudo groupadd fsgqa 2024-06-13T11:38:41.131 INFO:teuthology.orchestra.run.smithi043.stderr:groupadd: group 'fsgqa' already exists 2024-06-13T11:38:41.133 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-06-13T11:38:41.133 DEBUG:teuthology.orchestra.run.smithi043:> sudo useradd fsgqa2 2024-06-13T11:38:41.946 DEBUG:teuthology.orchestra.run.smithi043:> sudo useradd 123456-fsgqa 2024-06-13T11:38:42.764 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-06-13T11:38:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.880+0000 7ff15667b640 1 Processor -- start 2024-06-13T11:38:42.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.880+0000 7ff15667b640 1 -- start start 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff15667b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff150144c20 0x7ff1500cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff15667b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15015c9a0 0x7ff150072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff15667b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1500ccea0 con 0x7ff1500721b0 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff15667b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff150145000 con 0x7ff150144c20 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff15667b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff15015cea0 con 0x7ff15015c9a0 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff150144c20 0x7ff1500cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff150144c20 0x7ff1500cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35068/0 (socket says 172.21.15.43:35068) 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 -- 172.21.15.43:0/2926171600 learned_addr learned my addr 172.21.15.43:0/2926171600 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 -- 172.21.15.43:0/2926171600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15015c9a0 msgr2=0x7ff150072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 --2- 172.21.15.43:0/2926171600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15015c9a0 0x7ff150072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 -- 172.21.15.43:0/2926171600 >> v1:172.21.15.53:6789/0 conn(0x7ff1500721b0 legacy=0x7ff15015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:38:42.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.881+0000 7ff14ffff640 1 -- 172.21.15.43:0/2926171600 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15015d180 con 0x7ff150144c20 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.882+0000 7ff14ffff640 1 --2- 172.21.15.43:0/2926171600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff150144c20 0x7ff1500cc960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff140009870 tx=0x7ff14002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfe176be7706f34 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.882+0000 7ff14effd640 1 -- 172.21.15.43:0/2926171600 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140037070 con 0x7ff150144c20 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.882+0000 7ff14effd640 1 -- 172.21.15.43:0/2926171600 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff140032440 con 0x7ff150144c20 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.882+0000 7ff14effd640 1 -- 172.21.15.43:0/2926171600 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140032810 con 0x7ff150144c20 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 -- 172.21.15.43:0/2926171600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff150144c20 msgr2=0x7ff1500cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 --2- 172.21.15.43:0/2926171600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff150144c20 0x7ff1500cc960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff140009870 tx=0x7ff14002a180 comp rx=0 tx=0).stop 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 -- 172.21.15.43:0/2926171600 shutdown_connections 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 --2- 172.21.15.43:0/2926171600 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff15015c9a0 0x7ff150072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 --2- 172.21.15.43:0/2926171600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff150144c20 0x7ff1500cc960 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 -- 172.21.15.43:0/2926171600 >> 172.21.15.43:0/2926171600 conn(0x7ff1500b14b0 msgr2=0x7ff1500b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 -- 172.21.15.43:0/2926171600 shutdown_connections 2024-06-13T11:38:42.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.883+0000 7ff15667b640 1 -- 172.21.15.43:0/2926171600 wait complete. 2024-06-13T11:38:42.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.884+0000 7ff15667b640 1 Processor -- start 2024-06-13T11:38:42.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 -- start start 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 0x7ff15013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff150144c20 0x7ff1500ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15015c9a0 0x7ff1500710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff15015da20 con 0x7ff1500721b0 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff15015d740 con 0x7ff15015c9a0 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff15667b640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7ff15015df40 con 0x7ff150144c20 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 0x7ff15013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 0x7ff15013c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35078/0 (socket says 172.21.15.43:35078) 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.885+0000 7ff14ffff640 1 -- 172.21.15.43:0/80490656 learned_addr learned my addr 172.21.15.43:0/80490656 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff154c18640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15015c9a0 0x7ff1500710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:42.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14f7fe640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff150144c20 0x7ff1500ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14ffff640 1 -- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff150144c20 msgr2=0x7ff1500ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14ffff640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff150144c20 0x7ff1500ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14ffff640 1 -- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15015c9a0 msgr2=0x7ff1500710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14ffff640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15015c9a0 0x7ff1500710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14ffff640 1 -- 172.21.15.43:0/80490656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1501f2400 con 0x7ff1500721b0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14ffff640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 0x7ff15013c0e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff140009870 tx=0x7ff1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140041070 con 0x7ff1500721b0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14003c870 con 0x7ff1500721b0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1501f26e0 con 0x7ff1500721b0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140037040 con 0x7ff1500721b0 2024-06-13T11:38:42.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.886+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501f2ca0 con 0x7ff1500721b0 2024-06-13T11:38:42.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.887+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15004ffb0 con 0x7ff1500721b0 2024-06-13T11:38:42.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.888+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff140044070 con 0x7ff1500721b0 2024-06-13T11:38:42.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.888+0000 7ff14cff9640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff13c06be30 0x7ff13c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:42.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.888+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff1400abb40 con 0x7ff1500721b0 2024-06-13T11:38:42.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.889+0000 7ff14f7fe640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff13c06be30 0x7ff13c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:42.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.889+0000 7ff14f7fe640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff13c06be30 0x7ff13c06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff144007fd0 tx=0x7ff144009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:42.893+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff14007a350 con 0x7ff1500721b0 2024-06-13T11:38:43.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.152+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff1500cf230 con 0x7ff1500721b0 2024-06-13T11:38:43.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.152+0000 7ff14cff9640 1 -- 172.21.15.43:0/80490656 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1277 (secure 0 0 0) 0x7ff140079c50 con 0x7ff1500721b0 2024-06-13T11:38:43.152 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:38:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":1,"fsid":"3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5","modified":"2024-06-13T11:36:15.401475Z","created":"2024-06-13T11:36:15.401475Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3301","nonce":0},{"type":"v1","addr":"172.21.15.53:6790","nonce":0}]},"addr":"172.21.15.53:6790/0","public_addr":"172.21.15.53:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-06-13T11:38:43.152 INFO:teuthology.orchestra.run.smithi043.stderr:dumped monmap epoch 1 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff13c06be30 msgr2=0x7ff13c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff13c06be30 0x7ff13c06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff144007fd0 tx=0x7ff144009040 comp rx=0 tx=0).stop 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 msgr2=0x7ff15013c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 0x7ff15013c0e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff140009870 tx=0x7ff1400046c0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 shutdown_connections 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7ff13c06be30 0x7ff13c06e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15015c9a0 0x7ff1500710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7ff150144c20 0x7ff1500ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 --2- 172.21.15.43:0/80490656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1500721b0 0x7ff15013c0e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 >> 172.21.15.43:0/80490656 conn(0x7ff1500b14b0 msgr2=0x7ff1500cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:43.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 shutdown_connections 2024-06-13T11:38:43.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.154+0000 7ff15667b640 1 -- 172.21.15.43:0/80490656 wait complete. 2024-06-13T11:38:43.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-06-13T11:38:43.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.270+0000 7faf27102640 1 Processor -- start 2024-06-13T11:38:43.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.270+0000 7faf27102640 1 -- start start 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf27102640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf20144b90 0x7faf200721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf27102640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2015e050 con 0x7faf2015dc40 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf27102640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2015e2d0 con 0x7faf200726f0 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf27102640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faf20072b30 con 0x7faf20144b90 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf24e9e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf20144b90 0x7faf200721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf2569f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7faf2015dc40 0x7faf200cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52564/0 (socket says 172.21.15.43:52564) 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf2569f640 1 -- 172.21.15.43:0/3136226923 learned_addr learned my addr 172.21.15.43:0/3136226923 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf24e9e640 1 -- 172.21.15.43:0/3136226923 >> v1:172.21.15.53:6789/0 conn(0x7faf200726f0 legacy=0x7faf2015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf24e9e640 1 -- 172.21.15.43:0/3136226923 >> v1:172.21.15.43:6789/0 conn(0x7faf2015dc40 legacy=0x7faf200cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.271+0000 7faf24e9e640 1 -- 172.21.15.43:0/3136226923 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2015e5b0 con 0x7faf20144b90 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.272+0000 7faf24e9e640 1 --2- 172.21.15.43:0/3136226923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf200721b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faf20072cb0 tx=0x7faf1802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd1870142a82fb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.272+0000 7faf1f7fe640 1 -- 172.21.15.43:0/3136226923 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18037070 con 0x7faf20144b90 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.272+0000 7faf1f7fe640 1 -- 172.21.15.43:0/3136226923 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18007740 con 0x7faf20144b90 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.272+0000 7faf1f7fe640 1 -- 172.21.15.43:0/3136226923 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18007b10 con 0x7faf20144b90 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 -- 172.21.15.43:0/3136226923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 msgr2=0x7faf200721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 --2- 172.21.15.43:0/3136226923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf200721b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faf20072cb0 tx=0x7faf1802a780 comp rx=0 tx=0).stop 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 -- 172.21.15.43:0/3136226923 shutdown_connections 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 --2- 172.21.15.43:0/3136226923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf200721b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 -- 172.21.15.43:0/3136226923 >> 172.21.15.43:0/3136226923 conn(0x7faf200b14b0 msgr2=0x7faf200b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 -- 172.21.15.43:0/3136226923 shutdown_connections 2024-06-13T11:38:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.273+0000 7faf27102640 1 -- 172.21.15.43:0/3136226923 wait complete. 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.274+0000 7faf27102640 1 Processor -- start 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.274+0000 7faf27102640 1 -- start start 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf27102640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf200726f0 0x7faf2015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf27102640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf201e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf27102640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faf2015dc40 0x7faf201e8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf27102640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf2015eb70 con 0x7faf20144b90 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf27102640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faf200ccb00 con 0x7faf200726f0 2024-06-13T11:38:43.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf27102640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7faf20144f70 con 0x7faf2015dc40 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf1ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf201e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf1ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf201e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35084/0 (socket says 172.21.15.43:35084) 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf1ffff640 1 -- 172.21.15.43:0/110977995 learned_addr learned my addr 172.21.15.43:0/110977995 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf2569f640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faf2015dc40 0x7faf201e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.275+0000 7faf24e9e640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf200726f0 0x7faf2015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1ffff640 1 -- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faf2015dc40 msgr2=0x7faf201e8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1ffff640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faf2015dc40 0x7faf201e8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1ffff640 1 -- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf200726f0 msgr2=0x7faf2015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1ffff640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf200726f0 0x7faf2015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1ffff640 1 -- 172.21.15.43:0/110977995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf200abd80 con 0x7faf20144b90 2024-06-13T11:38:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf2569f640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faf2015dc40 0x7faf201e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf24e9e640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf200726f0 0x7faf2015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1ffff640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf201e7be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c430 tx=0x7faf1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf140052d0 con 0x7faf20144b90 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf14005490 con 0x7faf20144b90 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2012f6f0 con 0x7faf20144b90 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14007260 con 0x7faf20144b90 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.276+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2012fcb0 con 0x7faf20144b90 2024-06-13T11:38:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.277+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2004ffb0 con 0x7faf20144b90 2024-06-13T11:38:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.277+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf14007400 con 0x7faf20144b90 2024-06-13T11:38:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.278+0000 7faf1d7fa640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7faf0c06be30 0x7faf0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:38:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.278+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7faf1408a510 con 0x7faf20144b90 2024-06-13T11:38:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.278+0000 7faf24e9e640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7faf0c06be30 0x7faf0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:38:43.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.279+0000 7faf24e9e640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7faf0c06be30 0x7faf0c06e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faf18034000 tx=0x7faf1802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:38:43.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.282+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf14058d30 con 0x7faf20144b90 2024-06-13T11:38:43.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.540+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7faf2006fa70 con 0x7faf20144b90 2024-06-13T11:38:43.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.541+0000 7faf1d7fa640 1 -- 172.21.15.43:0/110977995 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) ==== 92+0+63 (secure 0 0 0) 0x7faf14058630 con 0x7faf20144b90 2024-06-13T11:38:43.540 INFO:teuthology.orchestra.run.smithi043.stdout:[client.admin] 2024-06-13T11:38:43.540 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7faf0c06be30 msgr2=0x7faf0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7faf0c06be30 0x7faf0c06e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faf18034000 tx=0x7faf1802e000 comp rx=0 tx=0).stop 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 msgr2=0x7faf201e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf201e7be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c430 tx=0x7faf1400c8f0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 shutdown_connections 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7faf0c06be30 0x7faf0c06e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7faf2015dc40 0x7faf201e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf20144b90 0x7faf201e7be0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 --2- 172.21.15.43:0/110977995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf200726f0 0x7faf2015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 >> 172.21.15.43:0/110977995 conn(0x7faf200b14b0 msgr2=0x7faf200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 shutdown_connections 2024-06-13T11:38:43.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T11:38:43.543+0000 7faf27102640 1 -- 172.21.15.43:0/110977995 wait complete. 2024-06-13T11:38:43.554 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:38:43.554 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/tmp/tmp.dHWHNRE83Nxfstests-dev/local.config 2024-06-13T11:38:43.580 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.43:6789:/test export TEST_DIR=/tmp/tmp.nZPIJ9BvOktest export SCRATCH_DEV=172.21.15.43:6789:/scratch export SCRATCH_MNT=/tmp/tmp.SrWmQymjYxscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg==" 2024-06-13T11:38:43.580 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T11:38:43.580 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/tmp/tmp.dHWHNRE83Nxfstests-dev/ceph.exclude 2024-06-13T11:38:43.645 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo make) 2024-06-13T11:38:43.724 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize -cfi 2024-06-13T11:38:43.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:38:43.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:38:44.158 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: putting auxiliary files in '.'. 2024-06-13T11:38:44.159 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './config.guess' 2024-06-13T11:38:44.162 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './config.sub' 2024-06-13T11:38:44.166 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './install-sh' 2024-06-13T11:38:44.170 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file './ltmain.sh' 2024-06-13T11:38:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-06-13T11:38:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-06-13T11:38:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-06-13T11:38:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-06-13T11:38:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-06-13T11:38:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-06-13T11:38:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-06-13T11:38:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:cp include/install-sh . 2024-06-13T11:38:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:aclocal -I m4 2024-06-13T11:38:45.251 INFO:teuthology.orchestra.run.smithi043.stdout:autoheader 2024-06-13T11:38:45.566 INFO:teuthology.orchestra.run.smithi043.stdout:autoconf 2024-06-13T11:38:45.742 INFO:teuthology.orchestra.run.smithi043.stdout:./configure \ 2024-06-13T11:38:45.742 INFO:teuthology.orchestra.run.smithi043.stdout: --libexecdir=/usr/lib \ 2024-06-13T11:38:45.742 INFO:teuthology.orchestra.run.smithi043.stdout: --exec_prefix=/var/lib 2024-06-13T11:38:46.134 INFO:teuthology.orchestra.run.smithi043.stdout:checking build system type... x86_64-pc-linux-gnu 2024-06-13T11:38:46.134 INFO:teuthology.orchestra.run.smithi043.stdout:checking host system type... x86_64-pc-linux-gnu 2024-06-13T11:38:46.135 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to print strings... printf 2024-06-13T11:38:46.135 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc... gcc 2024-06-13T11:38:46.241 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether the C compiler works... yes 2024-06-13T11:38:46.241 INFO:teuthology.orchestra.run.smithi043.stdout:checking for C compiler default output file name... a.out 2024-06-13T11:38:46.269 INFO:teuthology.orchestra.run.smithi043.stdout:checking for suffix of executables... 2024-06-13T11:38:46.358 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether we are cross compiling... no 2024-06-13T11:38:46.376 INFO:teuthology.orchestra.run.smithi043.stdout:checking for suffix of object files... o 2024-06-13T11:38:46.392 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether we are using the GNU C compiler... yes 2024-06-13T11:38:46.408 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether gcc accepts -g... yes 2024-06-13T11:38:46.459 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc option to accept ISO C89... none needed 2024-06-13T11:38:46.462 INFO:teuthology.orchestra.run.smithi043.stdout:checking for a sed that does not truncate output... /bin/sed 2024-06-13T11:38:46.464 INFO:teuthology.orchestra.run.smithi043.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-06-13T11:38:46.465 INFO:teuthology.orchestra.run.smithi043.stdout:checking for egrep... /bin/grep -E 2024-06-13T11:38:46.466 INFO:teuthology.orchestra.run.smithi043.stdout:checking for fgrep... /bin/grep -F 2024-06-13T11:38:46.469 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ld used by gcc... /bin/ld 2024-06-13T11:38:46.471 INFO:teuthology.orchestra.run.smithi043.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-06-13T11:38:46.479 INFO:teuthology.orchestra.run.smithi043.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-06-13T11:38:47.321 INFO:teuthology.orchestra.run.smithi043.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-06-13T11:38:47.321 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether ln -s works... yes 2024-06-13T11:38:47.331 INFO:teuthology.orchestra.run.smithi043.stdout:checking the maximum length of command line arguments... 1572864 2024-06-13T11:38:47.334 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-06-13T11:38:47.334 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-06-13T11:38:47.334 INFO:teuthology.orchestra.run.smithi043.stdout:checking for /bin/ld option to reload object files... -r 2024-06-13T11:38:47.334 INFO:teuthology.orchestra.run.smithi043.stdout:checking for objdump... objdump 2024-06-13T11:38:47.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to recognize dependent libraries... pass_all 2024-06-13T11:38:47.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dlltool... no 2024-06-13T11:38:47.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-06-13T11:38:47.335 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ar... ar 2024-06-13T11:38:47.378 INFO:teuthology.orchestra.run.smithi043.stdout:checking for archiver @FILE support... @ 2024-06-13T11:38:47.378 INFO:teuthology.orchestra.run.smithi043.stdout:checking for strip... strip 2024-06-13T11:38:47.378 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ranlib... ranlib 2024-06-13T11:38:47.378 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gawk... gawk 2024-06-13T11:38:47.445 INFO:teuthology.orchestra.run.smithi043.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-06-13T11:38:47.446 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sysroot... no 2024-06-13T11:38:47.449 INFO:teuthology.orchestra.run.smithi043.stdout:checking for a working dd... /bin/dd 2024-06-13T11:38:47.452 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-06-13T11:38:47.465 INFO:teuthology.orchestra.run.smithi043.stdout:checking for mt... no 2024-06-13T11:38:47.468 INFO:teuthology.orchestra.run.smithi043.stdout:checking if : is a manifest tool... no 2024-06-13T11:38:47.616 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to run the C preprocessor... gcc -E 2024-06-13T11:38:47.776 INFO:teuthology.orchestra.run.smithi043.stdout:checking for ANSI C header files... yes 2024-06-13T11:38:47.797 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/types.h... yes 2024-06-13T11:38:47.830 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/stat.h... yes 2024-06-13T11:38:47.854 INFO:teuthology.orchestra.run.smithi043.stdout:checking for stdlib.h... yes 2024-06-13T11:38:47.880 INFO:teuthology.orchestra.run.smithi043.stdout:checking for string.h... yes 2024-06-13T11:38:47.906 INFO:teuthology.orchestra.run.smithi043.stdout:checking for memory.h... yes 2024-06-13T11:38:47.932 INFO:teuthology.orchestra.run.smithi043.stdout:checking for strings.h... yes 2024-06-13T11:38:47.960 INFO:teuthology.orchestra.run.smithi043.stdout:checking for inttypes.h... yes 2024-06-13T11:38:47.986 INFO:teuthology.orchestra.run.smithi043.stdout:checking for stdint.h... yes 2024-06-13T11:38:48.016 INFO:teuthology.orchestra.run.smithi043.stdout:checking for unistd.h... yes 2024-06-13T11:38:48.042 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dlfcn.h... yes 2024-06-13T11:38:48.045 INFO:teuthology.orchestra.run.smithi043.stdout:checking for objdir... .libs 2024-06-13T11:38:48.111 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-06-13T11:38:48.111 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-06-13T11:38:48.127 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-06-13T11:38:48.157 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc static flag -static works... no 2024-06-13T11:38:48.178 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc supports -c -o file.o... yes 2024-06-13T11:38:48.179 INFO:teuthology.orchestra.run.smithi043.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-06-13T11:38:48.185 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-06-13T11:38:48.212 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether -lc should be explicitly linked in... no 2024-06-13T11:38:48.262 INFO:teuthology.orchestra.run.smithi043.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-06-13T11:38:48.262 INFO:teuthology.orchestra.run.smithi043.stdout:checking how to hardcode library paths into programs... immediate 2024-06-13T11:38:48.263 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether stripping libraries is possible... yes 2024-06-13T11:38:48.263 INFO:teuthology.orchestra.run.smithi043.stdout:checking if libtool supports shared libraries... yes 2024-06-13T11:38:48.263 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether to build shared libraries... yes 2024-06-13T11:38:48.264 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether to build static libraries... yes 2024-06-13T11:38:48.269 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc... (cached) gcc 2024-06-13T11:38:48.286 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-06-13T11:38:48.286 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether gcc accepts -g... (cached) yes 2024-06-13T11:38:48.286 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-06-13T11:38:48.286 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gmake... /usr/bin/gmake 2024-06-13T11:38:48.286 INFO:teuthology.orchestra.run.smithi043.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-06-13T11:38:48.287 INFO:teuthology.orchestra.run.smithi043.stdout:checking for tar... /bin/tar 2024-06-13T11:38:48.287 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gzip... /bin/gzip 2024-06-13T11:38:48.305 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether gcc -MM is supported... yes 2024-06-13T11:38:48.305 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sort... /bin/sort 2024-06-13T11:38:48.305 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether ln -s works... yes 2024-06-13T11:38:48.305 INFO:teuthology.orchestra.run.smithi043.stdout:checking for rpm... /bin/rpm 2024-06-13T11:38:48.309 INFO:teuthology.orchestra.run.smithi043.stdout:checking for rpmbuild... no 2024-06-13T11:38:48.334 INFO:teuthology.orchestra.run.smithi043.stdout:checking assert.h usability... yes 2024-06-13T11:38:48.343 INFO:teuthology.orchestra.run.smithi043.stdout:checking assert.h presence... yes 2024-06-13T11:38:48.343 INFO:teuthology.orchestra.run.smithi043.stdout:checking for assert.h... yes 2024-06-13T11:38:48.371 INFO:teuthology.orchestra.run.smithi043.stdout:checking bstring.h usability... no 2024-06-13T11:38:48.382 INFO:teuthology.orchestra.run.smithi043.stdout:checking bstring.h presence... no 2024-06-13T11:38:48.382 INFO:teuthology.orchestra.run.smithi043.stdout:checking for bstring.h... no 2024-06-13T11:38:48.407 INFO:teuthology.orchestra.run.smithi043.stdout:checking libgen.h usability... yes 2024-06-13T11:38:48.416 INFO:teuthology.orchestra.run.smithi043.stdout:checking libgen.h presence... yes 2024-06-13T11:38:48.416 INFO:teuthology.orchestra.run.smithi043.stdout:checking for libgen.h... yes 2024-06-13T11:38:48.445 INFO:teuthology.orchestra.run.smithi043.stdout:checking dirent.h usability... yes 2024-06-13T11:38:48.455 INFO:teuthology.orchestra.run.smithi043.stdout:checking dirent.h presence... yes 2024-06-13T11:38:48.455 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dirent.h... yes 2024-06-13T11:38:48.508 INFO:teuthology.orchestra.run.smithi043.stdout:checking errno.h usability... yes 2024-06-13T11:38:48.517 INFO:teuthology.orchestra.run.smithi043.stdout:checking errno.h presence... yes 2024-06-13T11:38:48.517 INFO:teuthology.orchestra.run.smithi043.stdout:checking for errno.h... yes 2024-06-13T11:38:48.546 INFO:teuthology.orchestra.run.smithi043.stdout:checking malloc.h usability... yes 2024-06-13T11:38:48.556 INFO:teuthology.orchestra.run.smithi043.stdout:checking malloc.h presence... yes 2024-06-13T11:38:48.556 INFO:teuthology.orchestra.run.smithi043.stdout:checking for malloc.h... yes 2024-06-13T11:38:48.583 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid.h usability... no 2024-06-13T11:38:48.595 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid.h presence... no 2024-06-13T11:38:48.595 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid.h... no 2024-06-13T11:38:48.623 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid/uuid.h usability... yes 2024-06-13T11:38:48.633 INFO:teuthology.orchestra.run.smithi043.stdout:checking uuid/uuid.h presence... yes 2024-06-13T11:38:48.634 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid/uuid.h... yes 2024-06-13T11:38:48.661 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/uuid.h usability... no 2024-06-13T11:38:48.672 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/uuid.h presence... no 2024-06-13T11:38:48.672 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/uuid.h... no 2024-06-13T11:38:48.699 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/file.h usability... yes 2024-06-13T11:38:48.709 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/file.h presence... yes 2024-06-13T11:38:48.709 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/file.h... yes 2024-06-13T11:38:48.738 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fcntl.h usability... yes 2024-06-13T11:38:48.747 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fcntl.h presence... yes 2024-06-13T11:38:48.747 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/fcntl.h... yes 2024-06-13T11:38:48.775 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/syssgi.h usability... no 2024-06-13T11:38:48.786 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/syssgi.h presence... no 2024-06-13T11:38:48.787 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/syssgi.h... no 2024-06-13T11:38:48.832 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/param.h usability... yes 2024-06-13T11:38:48.844 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/param.h presence... yes 2024-06-13T11:38:48.844 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/param.h... yes 2024-06-13T11:38:48.849 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/stat.h... (cached) yes 2024-06-13T11:38:48.877 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/statvfs.h usability... yes 2024-06-13T11:38:48.887 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/statvfs.h presence... yes 2024-06-13T11:38:48.887 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/statvfs.h... yes 2024-06-13T11:38:48.915 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/time.h usability... yes 2024-06-13T11:38:48.925 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/time.h presence... yes 2024-06-13T11:38:48.925 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/time.h... yes 2024-06-13T11:38:48.965 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/ioctl.h usability... yes 2024-06-13T11:38:48.973 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/ioctl.h presence... yes 2024-06-13T11:38:48.974 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/ioctl.h... yes 2024-06-13T11:38:49.008 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/wait.h usability... yes 2024-06-13T11:38:49.020 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/wait.h presence... yes 2024-06-13T11:38:49.020 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/wait.h... yes 2024-06-13T11:38:49.024 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/types.h... (cached) yes 2024-06-13T11:38:49.029 INFO:teuthology.orchestra.run.smithi043.stdout:checking for strings.h... (cached) yes 2024-06-13T11:38:49.058 INFO:teuthology.orchestra.run.smithi043.stdout:checking err.h usability... yes 2024-06-13T11:38:49.066 INFO:teuthology.orchestra.run.smithi043.stdout:checking err.h presence... yes 2024-06-13T11:38:49.067 INFO:teuthology.orchestra.run.smithi043.stdout:checking for err.h... yes 2024-06-13T11:38:49.096 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/falloc.h usability... yes 2024-06-13T11:38:49.104 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/falloc.h presence... yes 2024-06-13T11:38:49.104 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/falloc.h... yes 2024-06-13T11:38:49.138 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-06-13T11:38:49.149 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-06-13T11:38:49.150 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/fs/xfs_fsops.h... no 2024-06-13T11:38:49.175 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_itable.h usability... no 2024-06-13T11:38:49.186 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/fs/xfs_itable.h presence... no 2024-06-13T11:38:49.186 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/fs/xfs_itable.h... no 2024-06-13T11:38:49.213 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/platform_defs.h usability... no 2024-06-13T11:38:49.224 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/platform_defs.h presence... no 2024-06-13T11:38:49.224 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/platform_defs.h... no 2024-06-13T11:38:49.250 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfs/ioctl.h usability... no 2024-06-13T11:38:49.261 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfs/ioctl.h presence... no 2024-06-13T11:38:49.262 INFO:teuthology.orchestra.run.smithi043.stdout:checking for btrfs/ioctl.h... no 2024-06-13T11:38:49.287 INFO:teuthology.orchestra.run.smithi043.stdout:checking cifs/ioctl.h usability... no 2024-06-13T11:38:49.298 INFO:teuthology.orchestra.run.smithi043.stdout:checking cifs/ioctl.h presence... no 2024-06-13T11:38:49.298 INFO:teuthology.orchestra.run.smithi043.stdout:checking for cifs/ioctl.h... no 2024-06-13T11:38:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/mman.h usability... yes 2024-06-13T11:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/mman.h presence... yes 2024-06-13T11:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/mman.h... yes 2024-06-13T11:38:49.369 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/ext4.h usability... no 2024-06-13T11:38:49.380 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/ext4.h presence... no 2024-06-13T11:38:49.380 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/ext4.h... no 2024-06-13T11:38:49.392 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/xfs_log_format.h... no 2024-06-13T11:38:49.433 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid_compare... no 2024-06-13T11:38:49.465 INFO:teuthology.orchestra.run.smithi043.stdout:checking for uuid_compare in -luuid... yes 2024-06-13T11:38:49.533 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/xfs.h... yes 2024-06-13T11:38:49.547 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/libxfs.h... no 2024-06-13T11:38:49.563 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether xlog_assign_lsn is declared... no 2024-06-13T11:38:49.593 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/xqm.h... yes 2024-06-13T11:38:49.645 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfsctl from xfs/xfs.h... ok 2024-06-13T11:38:49.670 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/handle.h usability... yes 2024-06-13T11:38:49.678 INFO:teuthology.orchestra.run.smithi043.stdout:checking xfs/handle.h presence... yes 2024-06-13T11:38:49.678 INFO:teuthology.orchestra.run.smithi043.stdout:checking for xfs/handle.h... yes 2024-06-13T11:38:49.711 INFO:teuthology.orchestra.run.smithi043.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-06-13T11:38:49.738 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/acl.h usability... yes 2024-06-13T11:38:49.748 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/acl.h presence... yes 2024-06-13T11:38:49.748 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/acl.h... yes 2024-06-13T11:38:49.776 INFO:teuthology.orchestra.run.smithi043.stdout:checking acl/libacl.h usability... yes 2024-06-13T11:38:49.786 INFO:teuthology.orchestra.run.smithi043.stdout:checking acl/libacl.h presence... yes 2024-06-13T11:38:49.786 INFO:teuthology.orchestra.run.smithi043.stdout:checking for acl/libacl.h... yes 2024-06-13T11:38:49.819 INFO:teuthology.orchestra.run.smithi043.stdout:checking for acl_init in -lacl... yes 2024-06-13T11:38:49.843 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm-ndbm.h usability... no 2024-06-13T11:38:49.855 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm-ndbm.h presence... no 2024-06-13T11:38:49.855 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gdbm-ndbm.h... no 2024-06-13T11:38:49.879 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm/ndbm.h usability... yes 2024-06-13T11:38:49.890 INFO:teuthology.orchestra.run.smithi043.stdout:checking gdbm/ndbm.h presence... yes 2024-06-13T11:38:49.890 INFO:teuthology.orchestra.run.smithi043.stdout:checking for gdbm/ndbm.h... yes 2024-06-13T11:38:49.927 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_open in -lgdbm... no 2024-06-13T11:38:49.962 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_fetch in -lgdbm... no 2024-06-13T11:38:49.998 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_store in -lgdbm... no 2024-06-13T11:38:50.034 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_close in -lgdbm... no 2024-06-13T11:38:50.066 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-06-13T11:38:50.099 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-06-13T11:38:50.132 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-06-13T11:38:50.165 INFO:teuthology.orchestra.run.smithi043.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-06-13T11:38:50.190 INFO:teuthology.orchestra.run.smithi043.stdout:checking libaio.h usability... yes 2024-06-13T11:38:50.201 INFO:teuthology.orchestra.run.smithi043.stdout:checking libaio.h presence... yes 2024-06-13T11:38:50.201 INFO:teuthology.orchestra.run.smithi043.stdout:checking for libaio.h... yes 2024-06-13T11:38:50.225 INFO:teuthology.orchestra.run.smithi043.stdout:checking liburing.h usability... no 2024-06-13T11:38:50.237 INFO:teuthology.orchestra.run.smithi043.stdout:checking liburing.h presence... no 2024-06-13T11:38:50.237 INFO:teuthology.orchestra.run.smithi043.stdout:checking for liburing.h... no 2024-06-13T11:38:50.262 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/capability.h usability... yes 2024-06-13T11:38:50.273 INFO:teuthology.orchestra.run.smithi043.stdout:checking sys/capability.h presence... yes 2024-06-13T11:38:50.273 INFO:teuthology.orchestra.run.smithi043.stdout:checking for sys/capability.h... yes 2024-06-13T11:38:50.299 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fiemap.h usability... yes 2024-06-13T11:38:50.307 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fiemap.h presence... yes 2024-06-13T11:38:50.307 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/fiemap.h... yes 2024-06-13T11:38:50.342 INFO:teuthology.orchestra.run.smithi043.stdout:checking for fallocate... yes 2024-06-13T11:38:50.379 INFO:teuthology.orchestra.run.smithi043.stdout:checking for open_by_handle_at... yes 2024-06-13T11:38:50.404 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fs.h usability... yes 2024-06-13T11:38:50.413 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/fs.h presence... yes 2024-06-13T11:38:50.413 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/fs.h... yes 2024-06-13T11:38:50.436 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfsutil.h usability... no 2024-06-13T11:38:50.448 INFO:teuthology.orchestra.run.smithi043.stdout:checking btrfsutil.h presence... no 2024-06-13T11:38:50.448 INFO:teuthology.orchestra.run.smithi043.stdout:checking for btrfsutil.h... no 2024-06-13T11:38:50.486 INFO:teuthology.orchestra.run.smithi043.stdout:checking for copy_file_range... yes 2024-06-13T11:38:50.523 INFO:teuthology.orchestra.run.smithi043.stdout:checking for SEEK_DATA... yes 2024-06-13T11:38:50.575 INFO:teuthology.orchestra.run.smithi043.stdout:checking for BMV_OF_SHARED... yes 2024-06-13T11:38:50.613 INFO:teuthology.orchestra.run.smithi043.stdout:checking for nftw... yes 2024-06-13T11:38:50.651 INFO:teuthology.orchestra.run.smithi043.stdout:checking for RLIMIT_NOFILE... yes 2024-06-13T11:38:50.685 INFO:teuthology.orchestra.run.smithi043.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-06-13T11:38:50.720 INFO:teuthology.orchestra.run.smithi043.stdout:checking for FICLONE... yes 2024-06-13T11:38:50.755 INFO:teuthology.orchestra.run.smithi043.stdout:checking for renameat2... yes 2024-06-13T11:38:50.789 INFO:teuthology.orchestra.run.smithi043.stdout:checking for reallocarray... yes 2024-06-13T11:38:50.821 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct mount_attr... yes 2024-06-13T11:38:50.856 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_qgroup_limit... yes 2024-06-13T11:38:50.890 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-06-13T11:38:50.923 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-06-13T11:38:50.957 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-06-13T11:38:50.992 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-06-13T11:38:51.026 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-06-13T11:38:51.059 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-06-13T11:38:51.087 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs.h usability... yes 2024-06-13T11:38:51.096 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs.h presence... yes 2024-06-13T11:38:51.096 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/btrfs.h... yes 2024-06-13T11:38:51.126 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs_tree.h usability... yes 2024-06-13T11:38:51.136 INFO:teuthology.orchestra.run.smithi043.stdout:checking linux/btrfs_tree.h presence... yes 2024-06-13T11:38:51.136 INFO:teuthology.orchestra.run.smithi043.stdout:checking for linux/btrfs_tree.h... yes 2024-06-13T11:38:51.158 INFO:teuthology.orchestra.run.smithi043.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-06-13T11:38:51.180 INFO:teuthology.orchestra.run.smithi043.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-06-13T11:38:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:configure: creating ./config.status 2024-06-13T11:38:51.504 INFO:teuthology.orchestra.run.smithi043.stdout:config.status: creating include/builddefs 2024-06-13T11:38:51.515 INFO:teuthology.orchestra.run.smithi043.stdout:config.status: creating include/config.h 2024-06-13T11:38:51.524 INFO:teuthology.orchestra.run.smithi043.stdout:config.status: executing libtool commands 2024-06-13T11:38:51.564 INFO:teuthology.orchestra.run.smithi043.stdout:Building include 2024-06-13T11:38:51.567 INFO:teuthology.orchestra.run.smithi043.stdout:Building lib 2024-06-13T11:38:51.571 INFO:teuthology.orchestra.run.smithi043.stdout: [LTDEP] 2024-06-13T11:38:51.715 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dataascii.lo 2024-06-13T11:38:51.833 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] databin.lo 2024-06-13T11:38:51.971 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] datapid.lo 2024-06-13T11:38:52.070 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] file_lock.lo 2024-06-13T11:38:52.208 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] forker.lo 2024-06-13T11:38:52.340 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] pattern.lo 2024-06-13T11:38:52.454 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] open_flags.lo 2024-06-13T11:38:52.588 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] random_range.lo 2024-06-13T11:38:52.805 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] string_to_tokens.lo 2024-06-13T11:38:52.902 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] str_to_bytes.lo 2024-06-13T11:38:53.033 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] tlibio.lo 2024-06-13T11:38:53.263 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] write_log.lo 2024-06-13T11:38:53.491 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] random.lo 2024-06-13T11:38:53.590 INFO:teuthology.orchestra.run.smithi043.stdout: [LD] 2024-06-13T11:38:53.671 INFO:teuthology.orchestra.run.smithi043.stdout:Building ltp 2024-06-13T11:38:53.674 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2024-06-13T11:38:53.806 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] doio 2024-06-13T11:38:54.442 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsstress 2024-06-13T11:38:55.833 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsx 2024-06-13T11:38:56.536 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] growfiles 2024-06-13T11:38:57.024 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] iogen 2024-06-13T11:38:57.372 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-stress 2024-06-13T11:38:57.769 INFO:teuthology.orchestra.run.smithi043.stdout:Building src 2024-06-13T11:38:57.775 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2024-06-13T11:38:59.591 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2024-06-13T11:38:59.623 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2024-06-13T11:38:59.631 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2024-06-13T11:38:59.854 INFO:teuthology.orchestra.run.smithi043.stdout: [DEP] 2024-06-13T11:38:59.876 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dirstress 2024-06-13T11:39:00.090 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fill 2024-06-13T11:39:00.226 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fill2 2024-06-13T11:39:00.435 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] getpagesize 2024-06-13T11:39:00.555 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] holes 2024-06-13T11:39:00.728 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] lstat64 2024-06-13T11:39:00.891 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] nametest 2024-06-13T11:39:01.112 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] permname 2024-06-13T11:39:01.290 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] randholes 2024-06-13T11:39:01.517 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] runas 2024-06-13T11:39:01.674 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] truncfile 2024-06-13T11:39:01.832 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] usemem 2024-06-13T11:39:01.964 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mmapcat 2024-06-13T11:39:02.094 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] append_reader 2024-06-13T11:39:02.227 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] append_writer 2024-06-13T11:39:02.358 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dirperf 2024-06-13T11:39:02.564 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] metaperf 2024-06-13T11:39:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] devzero 2024-06-13T11:39:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] feature 2024-06-13T11:39:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] alloc 2024-06-13T11:39:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fault 2024-06-13T11:39:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fstest 2024-06-13T11:39:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_access_root 2024-06-13T11:39:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] godown 2024-06-13T11:39:03.999 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] resvtest 2024-06-13T11:39:04.163 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] writemod 2024-06-13T11:39:04.289 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] writev_on_pagefault 2024-06-13T11:39:04.429 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] makeextents 2024-06-13T11:39:04.589 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] itrash 2024-06-13T11:39:04.722 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] rename 2024-06-13T11:39:04.843 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] multi_open_unlink 2024-06-13T11:39:04.990 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] unwritten_sync 2024-06-13T11:39:05.149 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] genhashnames 2024-06-13T11:39:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_holes 2024-06-13T11:39:05.450 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_writev 2024-06-13T11:39:05.583 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_truncate_cmtime 2024-06-13T11:39:05.721 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dirhash_collide 2024-06-13T11:39:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_rename_overwrite 2024-06-13T11:39:06.017 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] holetest 2024-06-13T11:39:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_truncate_self 2024-06-13T11:39:06.347 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] af_unix 2024-06-13T11:39:06.482 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_stale_pmd 2024-06-13T11:39:06.616 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_cow_race 2024-06-13T11:39:06.763 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_fallocate 2024-06-13T11:39:06.895 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsync-err 2024-06-13T11:39:07.060 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_write_ro 2024-06-13T11:39:07.193 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_ext4_dax_journal_corruption 2024-06-13T11:39:07.333 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_ext4_dax_inline_corruption 2024-06-13T11:39:07.469 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_ofd_locks 2024-06-13T11:39:07.645 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_collision 2024-06-13T11:39:07.824 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mmap-write-concurrent 2024-06-13T11:39:07.974 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_get_file_time 2024-06-13T11:39:08.102 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_create_short_dirs 2024-06-13T11:39:08.251 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_create_long_dirs 2024-06-13T11:39:08.399 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_enospc 2024-06-13T11:39:08.577 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_writev_overlap 2024-06-13T11:39:08.728 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] checkpoint_journal 2024-06-13T11:39:08.864 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mmap-rw-fault 2024-06-13T11:39:09.028 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] allocstale 2024-06-13T11:39:09.178 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_cow_memory_failure 2024-06-13T11:39:09.328 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fake-dump-rootino 2024-06-13T11:39:09.462 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dio-buf-fault 2024-06-13T11:39:09.597 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] rewinddir-test 2024-06-13T11:39:09.748 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] readdir-while-renames 2024-06-13T11:39:09.892 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] xfsctl 2024-06-13T11:39:10.063 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bstat 2024-06-13T11:39:10.249 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mtab 2024-06-13T11:39:10.416 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] getdevicesize 2024-06-13T11:39:10.540 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] preallo_rw_pattern_reader 2024-06-13T11:39:10.681 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] preallo_rw_pattern_writer 2024-06-13T11:39:10.820 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] ftrunc 2024-06-13T11:39:10.950 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] trunc 2024-06-13T11:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fs_perms 2024-06-13T11:39:11.239 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] testx 2024-06-13T11:39:11.354 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] looptest 2024-06-13T11:39:11.526 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] locktest 2024-06-13T11:39:11.810 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] unwritten_mmap 2024-06-13T11:39:11.954 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bulkstat_unlink_test 2024-06-13T11:39:12.136 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] deduperace 2024-06-13T11:39:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bulkstat_unlink_test_modified 2024-06-13T11:39:12.486 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_dir_offset 2024-06-13T11:39:12.616 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_futimens 2024-06-13T11:39:12.740 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_immutable 2024-06-13T11:39:13.327 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] stale_handle 2024-06-13T11:39:13.478 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] pwrite_mmap_blocked 2024-06-13T11:39:13.612 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_dir_offset2 2024-06-13T11:39:13.784 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] seek_sanity_test 2024-06-13T11:39:13.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:39:13.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:39:14.197 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] seek_copy_test 2024-06-13T11:39:14.354 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_readdir_1 2024-06-13T11:39:14.484 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_readdir_2 2024-06-13T11:39:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fsync-tester 2024-06-13T11:39:14.845 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] nsexec 2024-06-13T11:39:15.002 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] cloner 2024-06-13T11:39:15.160 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] renameat2 2024-06-13T11:39:15.308 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_getcwd 2024-06-13T11:39:15.449 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] e4compact 2024-06-13T11:39:15.630 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] test-nextquota 2024-06-13T11:39:15.782 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] punch-alternating 2024-06-13T11:39:15.933 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] attr-list-by-handle-cursor-test 2024-06-13T11:39:16.082 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] listxattr 2024-06-13T11:39:16.211 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dio-interleaved 2024-06-13T11:39:16.355 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_dir_type 2024-06-13T11:39:16.493 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dio-invalidate-cache 2024-06-13T11:39:16.676 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] stat_test 2024-06-13T11:39:16.945 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_encrypted_d_revalidate 2024-06-13T11:39:17.091 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] attr_replace_test 2024-06-13T11:39:17.234 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] swapon 2024-06-13T11:39:17.380 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mkswap 2024-06-13T11:39:17.513 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_attr_corruption 2024-06-13T11:39:17.645 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_open_tmpfiles 2024-06-13T11:39:17.806 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fscrypt-crypt-util 2024-06-13T11:39:18.447 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] bulkstat_null_ocount 2024-06-13T11:39:18.599 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] splice-test 2024-06-13T11:39:18.748 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] chprojid_fail 2024-06-13T11:39:18.891 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] detached_mounts_propagation 2024-06-13T11:39:19.055 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] ext4_resize 2024-06-13T11:39:19.187 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_readdir_3 2024-06-13T11:39:19.361 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] splice2pipe 2024-06-13T11:39:19.505 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] uuid_ioctl 2024-06-13T11:39:19.642 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_snapshot_deleted_subvolume 2024-06-13T11:39:19.787 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fiemap-fault 2024-06-13T11:39:19.925 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fiemap-tester 2024-06-13T11:39:20.166 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_stripealign 2024-06-13T11:39:20.301 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] open_by_handle 2024-06-13T11:39:20.529 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] dbtest 2024-06-13T11:39:20.756 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_mmap_dio 2024-06-13T11:39:20.898 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] xfsfind 2024-06-13T11:39:21.072 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] t_reflink_read_race 2024-06-13T11:39:21.245 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] fssum 2024-06-13T11:39:21.660 INFO:teuthology.orchestra.run.smithi043.stdout:Building log-writes 2024-06-13T11:39:21.665 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] replay-log 2024-06-13T11:39:21.967 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2024-06-13T11:39:21.970 INFO:teuthology.orchestra.run.smithi043.stdout:Building aio-dio-regress 2024-06-13T11:39:21.976 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aiocp 2024-06-13T11:39:22.182 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-append-write-fallocate-race 2024-06-13T11:39:22.332 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-append-write-read-race 2024-06-13T11:39:22.488 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-cow-race 2024-06-13T11:39:22.623 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-cycle-write 2024-06-13T11:39:22.787 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-eof-race 2024-06-13T11:39:22.953 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-extend-stat 2024-06-13T11:39:23.097 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-fcntl-race 2024-06-13T11:39:23.243 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-hole-filling-race 2024-06-13T11:39:23.373 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-invalidate-failure 2024-06-13T11:39:23.515 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-invalidate-readahead 2024-06-13T11:39:23.662 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aiodio_sparse2 2024-06-13T11:39:23.859 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-subblock-eof-read 2024-06-13T11:39:23.984 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-dio-write-verify 2024-06-13T11:39:24.162 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-06-13T11:39:24.278 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-06-13T11:39:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] aio-last-ref-held-by-io 2024-06-13T11:39:24.552 INFO:teuthology.orchestra.run.smithi043.stdout:Building vfs 2024-06-13T11:39:24.557 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] vfstest 2024-06-13T11:39:28.004 INFO:teuthology.orchestra.run.smithi043.stdout: [CC] mount-idmapped 2024-06-13T11:39:28.364 INFO:teuthology.orchestra.run.smithi043.stdout:Building m4 2024-06-13T11:39:28.367 INFO:teuthology.orchestra.run.smithi043.stdout:Building common 2024-06-13T11:39:28.371 INFO:teuthology.orchestra.run.smithi043.stdout:Building tests 2024-06-13T11:39:28.377 INFO:teuthology.orchestra.run.smithi043.stdout:Building btrfs 2024-06-13T11:39:28.382 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/btrfs/group.list 2024-06-13T11:39:28.448 INFO:teuthology.orchestra.run.smithi043.stdout:Building ceph 2024-06-13T11:39:28.453 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ceph/group.list 2024-06-13T11:39:28.468 INFO:teuthology.orchestra.run.smithi043.stdout:Building cifs 2024-06-13T11:39:28.474 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/cifs/group.list 2024-06-13T11:39:28.487 INFO:teuthology.orchestra.run.smithi043.stdout:Building ext4 2024-06-13T11:39:28.492 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ext4/group.list 2024-06-13T11:39:28.533 INFO:teuthology.orchestra.run.smithi043.stdout:Building f2fs 2024-06-13T11:39:28.538 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/f2fs/group.list 2024-06-13T11:39:28.556 INFO:teuthology.orchestra.run.smithi043.stdout:Building generic 2024-06-13T11:39:28.563 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/generic/group.list 2024-06-13T11:39:28.668 INFO:teuthology.orchestra.run.smithi043.stdout:Building nfs 2024-06-13T11:39:28.673 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/nfs/group.list 2024-06-13T11:39:28.688 INFO:teuthology.orchestra.run.smithi043.stdout:Building ocfs2 2024-06-13T11:39:28.694 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ocfs2/group.list 2024-06-13T11:39:28.708 INFO:teuthology.orchestra.run.smithi043.stdout:Building overlay 2024-06-13T11:39:28.713 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/overlay/group.list 2024-06-13T11:39:28.757 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2024-06-13T11:39:28.762 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/perf/group.list 2024-06-13T11:39:28.774 INFO:teuthology.orchestra.run.smithi043.stdout:Building selftest 2024-06-13T11:39:28.780 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/selftest/group.list 2024-06-13T11:39:28.793 INFO:teuthology.orchestra.run.smithi043.stdout:Building tmpfs 2024-06-13T11:39:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/tmpfs/group.list 2024-06-13T11:39:28.812 INFO:teuthology.orchestra.run.smithi043.stdout:Building udf 2024-06-13T11:39:28.818 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/udf/group.list 2024-06-13T11:39:28.830 INFO:teuthology.orchestra.run.smithi043.stdout:Building xfs 2024-06-13T11:39:28.836 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/xfs/group.list 2024-06-13T11:39:28.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo make install) 2024-06-13T11:39:28.980 INFO:teuthology.orchestra.run.smithi043.stdout:Building include 2024-06-13T11:39:28.983 INFO:teuthology.orchestra.run.smithi043.stdout:Building lib 2024-06-13T11:39:28.988 INFO:teuthology.orchestra.run.smithi043.stdout:Building ltp 2024-06-13T11:39:28.992 INFO:teuthology.orchestra.run.smithi043.stdout:Building src 2024-06-13T11:39:29.027 INFO:teuthology.orchestra.run.smithi043.stdout:Building log-writes 2024-06-13T11:39:29.031 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2024-06-13T11:39:29.034 INFO:teuthology.orchestra.run.smithi043.stdout:Building aio-dio-regress 2024-06-13T11:39:29.039 INFO:teuthology.orchestra.run.smithi043.stdout:Building vfs 2024-06-13T11:39:29.042 INFO:teuthology.orchestra.run.smithi043.stdout:Building m4 2024-06-13T11:39:29.046 INFO:teuthology.orchestra.run.smithi043.stdout:Building common 2024-06-13T11:39:29.050 INFO:teuthology.orchestra.run.smithi043.stdout:Building tests 2024-06-13T11:39:29.055 INFO:teuthology.orchestra.run.smithi043.stdout:Building btrfs 2024-06-13T11:39:29.061 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/btrfs/group.list 2024-06-13T11:39:29.127 INFO:teuthology.orchestra.run.smithi043.stdout:Building ceph 2024-06-13T11:39:29.132 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ceph/group.list 2024-06-13T11:39:29.147 INFO:teuthology.orchestra.run.smithi043.stdout:Building cifs 2024-06-13T11:39:29.153 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/cifs/group.list 2024-06-13T11:39:29.166 INFO:teuthology.orchestra.run.smithi043.stdout:Building ext4 2024-06-13T11:39:29.171 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ext4/group.list 2024-06-13T11:39:29.212 INFO:teuthology.orchestra.run.smithi043.stdout:Building f2fs 2024-06-13T11:39:29.217 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/f2fs/group.list 2024-06-13T11:39:29.236 INFO:teuthology.orchestra.run.smithi043.stdout:Building generic 2024-06-13T11:39:29.242 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/generic/group.list 2024-06-13T11:39:29.345 INFO:teuthology.orchestra.run.smithi043.stdout:Building nfs 2024-06-13T11:39:29.350 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/nfs/group.list 2024-06-13T11:39:29.366 INFO:teuthology.orchestra.run.smithi043.stdout:Building ocfs2 2024-06-13T11:39:29.371 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ocfs2/group.list 2024-06-13T11:39:29.385 INFO:teuthology.orchestra.run.smithi043.stdout:Building overlay 2024-06-13T11:39:29.391 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/overlay/group.list 2024-06-13T11:39:29.434 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2024-06-13T11:39:29.439 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/perf/group.list 2024-06-13T11:39:29.451 INFO:teuthology.orchestra.run.smithi043.stdout:Building selftest 2024-06-13T11:39:29.457 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/selftest/group.list 2024-06-13T11:39:29.470 INFO:teuthology.orchestra.run.smithi043.stdout:Building tmpfs 2024-06-13T11:39:29.475 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/tmpfs/group.list 2024-06-13T11:39:29.490 INFO:teuthology.orchestra.run.smithi043.stdout:Building udf 2024-06-13T11:39:29.495 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/udf/group.list 2024-06-13T11:39:29.507 INFO:teuthology.orchestra.run.smithi043.stdout:Building xfs 2024-06-13T11:39:29.514 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/xfs/group.list 2024-06-13T11:39:29.615 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-06-13T11:39:29.617 INFO:teuthology.orchestra.run.smithi043.stdout:gmake[1]: Nothing to be done for 'install'. 2024-06-13T11:39:29.617 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-06-13T11:39:29.619 INFO:teuthology.orchestra.run.smithi043.stdout:gmake[1]: Nothing to be done for 'install'. 2024-06-13T11:39:29.619 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-06-13T11:39:29.621 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-06-13T11:39:29.630 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-06-13T11:39:29.702 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-06-13T11:39:29.712 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-06-13T11:39:29.729 INFO:teuthology.orchestra.run.smithi043.stdout:Building log-writes 2024-06-13T11:39:29.733 INFO:teuthology.orchestra.run.smithi043.stdout:Building perf 2024-06-13T11:39:29.736 INFO:teuthology.orchestra.run.smithi043.stdout:Building aio-dio-regress 2024-06-13T11:39:29.741 INFO:teuthology.orchestra.run.smithi043.stdout:Building vfs 2024-06-13T11:39:29.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C log-writes install 2024-06-13T11:39:29.745 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-06-13T11:39:29.754 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-06-13T11:39:29.764 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C perf install 2024-06-13T11:39:29.765 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-06-13T11:39:29.774 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-06-13T11:39:29.797 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-06-13T11:39:29.799 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-06-13T11:39:29.808 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-06-13T11:39:29.861 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake -C vfs install 2024-06-13T11:39:29.862 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-06-13T11:39:29.871 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-06-13T11:39:29.884 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-06-13T11:39:29.893 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-06-13T11:39:31.123 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-06-13T11:39:31.222 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-06-13T11:39:31.247 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-06-13T11:39:31.249 INFO:teuthology.orchestra.run.smithi043.stdout:gmake[1]: Nothing to be done for 'install'. 2024-06-13T11:39:31.249 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-06-13T11:39:31.250 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-06-13T11:39:31.259 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-06-13T11:39:31.399 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-06-13T11:39:31.401 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/btrfs/ install 2024-06-13T11:39:31.404 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/btrfs/group.list 2024-06-13T11:39:31.469 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-06-13T11:39:31.478 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 313 314 315 316 317 318 320 330 /var/lib/xfstests/tests/btrfs 2024-06-13T11:39:32.344 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-06-13T11:39:32.353 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 313.out 314.out 315.out 316.out 317.out 318.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-06-13T11:39:33.220 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ceph/ install 2024-06-13T11:39:33.223 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ceph/group.list 2024-06-13T11:39:33.237 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-06-13T11:39:33.246 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-06-13T11:39:33.265 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-06-13T11:39:33.274 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-06-13T11:39:33.294 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/cifs/ install 2024-06-13T11:39:33.297 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/cifs/group.list 2024-06-13T11:39:33.309 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-06-13T11:39:33.318 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-06-13T11:39:33.327 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-06-13T11:39:33.336 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-06-13T11:39:33.345 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ext4/ install 2024-06-13T11:39:33.348 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ext4/group.list 2024-06-13T11:39:33.388 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-06-13T11:39:33.397 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-06-13T11:39:33.586 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-06-13T11:39:33.595 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-06-13T11:39:33.793 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/f2fs/ install 2024-06-13T11:39:33.795 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/f2fs/group.list 2024-06-13T11:39:33.813 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-06-13T11:39:33.821 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-06-13T11:39:33.833 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-06-13T11:39:33.842 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-06-13T11:39:33.854 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/generic/ install 2024-06-13T11:39:33.858 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/generic/group.list 2024-06-13T11:39:33.962 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-06-13T11:39:33.971 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 /var/lib/xfstests/tests/generic 2024-06-13T11:39:35.975 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-06-13T11:39:35.984 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out /var/lib/xfstests/tests/generic 2024-06-13T11:39:38.024 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/nfs/ install 2024-06-13T11:39:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/nfs/group.list 2024-06-13T11:39:38.041 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-06-13T11:39:38.050 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-06-13T11:39:38.058 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-06-13T11:39:38.068 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-06-13T11:39:38.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ocfs2/ install 2024-06-13T11:39:38.080 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/ocfs2/group.list 2024-06-13T11:39:38.093 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-06-13T11:39:38.101 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-06-13T11:39:38.111 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-06-13T11:39:38.120 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-06-13T11:39:38.129 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/overlay/ install 2024-06-13T11:39:38.131 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/overlay/group.list 2024-06-13T11:39:38.174 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-06-13T11:39:38.183 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-06-13T11:39:38.470 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-06-13T11:39:38.479 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-06-13T11:39:38.767 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/perf/ install 2024-06-13T11:39:38.769 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/perf/group.list 2024-06-13T11:39:38.780 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-06-13T11:39:38.789 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-06-13T11:39:38.798 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-06-13T11:39:38.807 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-06-13T11:39:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/selftest/ install 2024-06-13T11:39:38.819 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/selftest/group.list 2024-06-13T11:39:38.832 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-06-13T11:39:38.840 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-06-13T11:39:38.863 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-06-13T11:39:38.871 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-06-13T11:39:38.894 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/tmpfs/ install 2024-06-13T11:39:38.897 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/tmpfs/group.list 2024-06-13T11:39:38.910 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-06-13T11:39:38.919 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-06-13T11:39:38.928 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-06-13T11:39:38.937 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-06-13T11:39:38.947 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/udf/ install 2024-06-13T11:39:38.950 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/udf/group.list 2024-06-13T11:39:38.961 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-06-13T11:39:38.969 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-06-13T11:39:38.979 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-06-13T11:39:38.987 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-06-13T11:39:38.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/xfs/ install 2024-06-13T11:39:39.001 INFO:teuthology.orchestra.run.smithi043.stdout: [GROUP] /tmp/tmp.dHWHNRE83Nxfstests-dev/tests/xfs/group.list 2024-06-13T11:39:39.105 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-06-13T11:39:39.114 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 612 613 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-06-13T11:39:41.016 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-06-13T11:39:41.025 INFO:teuthology.orchestra.run.smithi043.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 612.out 613.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-06-13T11:39:42.963 INFO:teuthology.orchestra.run.smithi043.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-06-13T11:39:42.972 INFO:teuthology.orchestra.run.smithi043.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-06-13T11:39:42.981 INFO:teuthology.orchestra.run.smithi043.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-06-13T11:39:42.990 INFO:teuthology.orchestra.run.smithi043.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-06-13T11:39:43.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:39:43.002 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec ls tests/generic) 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:001 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:001.out 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:002 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:002.out 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:003 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:003.out 2024-06-13T11:39:43.060 INFO:teuthology.orchestra.run.smithi043.stdout:004 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:004.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:005 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:005.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:006 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:006.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:007 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:007.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:008 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:008.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:009 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:009.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:010 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:010.out 2024-06-13T11:39:43.061 INFO:teuthology.orchestra.run.smithi043.stdout:011 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:011.out 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:012 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:012.out 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:013 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:013.out 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:014 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:014.out 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:015 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:015.out 2024-06-13T11:39:43.062 INFO:teuthology.orchestra.run.smithi043.stdout:016 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:016.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:017 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:017.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:018 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:018.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:019 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:019.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:020 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:020.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:021 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:021.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:022 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:022.out 2024-06-13T11:39:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:023 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:023.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:024 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:024.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:025 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:025.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:026 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:026.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:027 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:027.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:028 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:028.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:029 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:029.out 2024-06-13T11:39:43.064 INFO:teuthology.orchestra.run.smithi043.stdout:030 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:030.out 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:031 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:031.out 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:032 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:032.out 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:033 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:033.out 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:034 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:034.out 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:035 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:035.cfg 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:035.out.default 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:035.out.nfs 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:036 2024-06-13T11:39:43.065 INFO:teuthology.orchestra.run.smithi043.stdout:036.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:037 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:037.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:038 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:038.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:039 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:039.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:040 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:040.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:041 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:041.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:042 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:042.out 2024-06-13T11:39:43.066 INFO:teuthology.orchestra.run.smithi043.stdout:043 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:043.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:044 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:044.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:045 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:045.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:046 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:046.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:047 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:047.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:048 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:048.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:049 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:049.out 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:050 2024-06-13T11:39:43.067 INFO:teuthology.orchestra.run.smithi043.stdout:050.cfg 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:050.out.default 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:050.out.nojournal 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:050.out.xfsquota 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:051 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:051.out 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:052 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:052.out 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:053 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:053.out 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:054 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:054.out 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:055 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:055.out 2024-06-13T11:39:43.068 INFO:teuthology.orchestra.run.smithi043.stdout:056 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:056.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:057 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:057.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:058 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:058.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:059 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:059.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:060 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:060.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:061 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:061.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:062 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:062.out 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:063 2024-06-13T11:39:43.069 INFO:teuthology.orchestra.run.smithi043.stdout:063.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:064 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:064.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:065 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:065.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:066 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:066.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:067 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:067.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:068 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:068.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:069 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:069.out 2024-06-13T11:39:43.070 INFO:teuthology.orchestra.run.smithi043.stdout:070 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:070.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:071 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:071.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:072 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:072.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:073 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:073.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:074 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:074.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:075 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:075.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:076 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:076.out 2024-06-13T11:39:43.071 INFO:teuthology.orchestra.run.smithi043.stdout:077 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:077.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:078 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:078.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:079 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:079.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:080 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:080.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:081 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:081.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:082 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:082.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:083 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:083.out 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:084 2024-06-13T11:39:43.072 INFO:teuthology.orchestra.run.smithi043.stdout:084.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:085 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:085.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:086 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:086.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:087 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:087.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:088 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:088.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:089 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:089.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:090 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:090.out 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:091 2024-06-13T11:39:43.073 INFO:teuthology.orchestra.run.smithi043.stdout:091.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:092 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:092.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:093 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:093.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:094 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:094.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:095 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:095.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:096 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:096.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:097 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:097.out 2024-06-13T11:39:43.074 INFO:teuthology.orchestra.run.smithi043.stdout:098 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:098.out 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:099 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:099.out 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:100 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:100.out 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:101 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:101.out 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:102 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:102.out 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:103 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:103.out 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:104 2024-06-13T11:39:43.075 INFO:teuthology.orchestra.run.smithi043.stdout:104.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:105 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:105.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:106 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:106.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:107 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:107.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:108 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:108.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:109 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:109.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:110 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:110.out 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:111 2024-06-13T11:39:43.076 INFO:teuthology.orchestra.run.smithi043.stdout:111.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:112 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:112.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:113 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:113.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:114 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:114.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:115 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:115.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:116 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:116.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:117 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:117.out 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:118 2024-06-13T11:39:43.077 INFO:teuthology.orchestra.run.smithi043.stdout:118.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:119 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:119.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:120 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:120.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:121 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:121.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:122 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:122.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:123 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:123.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:124 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:124.out 2024-06-13T11:39:43.078 INFO:teuthology.orchestra.run.smithi043.stdout:125 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:125.out 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:126 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:126.out 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:127 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:127.out 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:128 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:128.out 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:129 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:129.out 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:130 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:130.out 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:131 2024-06-13T11:39:43.079 INFO:teuthology.orchestra.run.smithi043.stdout:131.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:132 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:132.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:133 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:133.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:134 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:134.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:135 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:135.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:136 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:136.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:137 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:137.out 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:138 2024-06-13T11:39:43.080 INFO:teuthology.orchestra.run.smithi043.stdout:138.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:139 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:139.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:140 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:140.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:141 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:141.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:142 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:142.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:143 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:143.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:144 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:144.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:145 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:145.out 2024-06-13T11:39:43.081 INFO:teuthology.orchestra.run.smithi043.stdout:146 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:146.out 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:147 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:147.out 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:148 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:148.out 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:149 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:149.out 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:150 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:150.out 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:151 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:151.out 2024-06-13T11:39:43.082 INFO:teuthology.orchestra.run.smithi043.stdout:152 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:152.out 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:153 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:153.out 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:154 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:154.out 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:155 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:155.out 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:156 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:156.out 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:157 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:157.out 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:158 2024-06-13T11:39:43.083 INFO:teuthology.orchestra.run.smithi043.stdout:158.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:159 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:159.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:160 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:160.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:161 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:161.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:162 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:162.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:163 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:163.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:164 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:164.out 2024-06-13T11:39:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:165 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:165.out 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:166 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:166.out 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:167 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:167.out 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:168 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:168.out 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:169 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:169.out 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:170 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:170.out 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:171 2024-06-13T11:39:43.085 INFO:teuthology.orchestra.run.smithi043.stdout:171.out 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:172 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:172.out 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:173 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:173.out 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:174 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:174.out 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:175 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:175.out 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:176 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:176.out 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:177 2024-06-13T11:39:43.086 INFO:teuthology.orchestra.run.smithi043.stdout:177.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:178 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:178.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:179 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:179.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:180 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:180.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:181 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:181.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:182 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:182.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:183 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:183.out 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:184 2024-06-13T11:39:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:184.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:185 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:185.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:186 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:186.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:187 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:187.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:188 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:188.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:189 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:189.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:190 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:190.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:191 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:191.out 2024-06-13T11:39:43.088 INFO:teuthology.orchestra.run.smithi043.stdout:192 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:192.out 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:193 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:193.out 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:194 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:194.out 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:195 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:195.out 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:196 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:196.out 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:197 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:197.out 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:198 2024-06-13T11:39:43.089 INFO:teuthology.orchestra.run.smithi043.stdout:198.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:199 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:199.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:200 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:200.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:201 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:201.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:202 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:202.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:203 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:203.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:204 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:204.out 2024-06-13T11:39:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:205 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:205.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:206 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:206.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:207 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:207.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:208 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:208.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:209 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:209.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:210 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:210.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:211 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:211.out 2024-06-13T11:39:43.091 INFO:teuthology.orchestra.run.smithi043.stdout:212 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:212.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:213 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:213.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:214 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:214.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:215 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:215.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:216 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:216.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:217 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:217.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:218 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:218.out 2024-06-13T11:39:43.092 INFO:teuthology.orchestra.run.smithi043.stdout:219 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:219.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:220 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:220.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:221 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:221.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:222 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:222.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:223 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:223.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:224 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:224.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:225 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:225.out 2024-06-13T11:39:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:226 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:226.out 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:227 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:227.out 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:228 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:228.out 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:229 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:229.out 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:230 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:230.out 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:231 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:231.out 2024-06-13T11:39:43.094 INFO:teuthology.orchestra.run.smithi043.stdout:232 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:232.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:233 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:233.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:234 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:234.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:235 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:235.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:236 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:236.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:237 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:237.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:238 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:238.out 2024-06-13T11:39:43.095 INFO:teuthology.orchestra.run.smithi043.stdout:239 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:239.out 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:240 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:240.out 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:241 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:241.out 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:242 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:242.out 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:243 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:243.out 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:244 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:244.out 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:245 2024-06-13T11:39:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:245.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:246 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:246.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:247 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:247.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:248 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:248.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:249 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:249.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:250 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:250.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:251 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:251.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:252 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:252.out 2024-06-13T11:39:43.097 INFO:teuthology.orchestra.run.smithi043.stdout:253 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:253.out 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:254 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:254.out 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:255 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:255.out 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:256 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:256.out 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:257 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:257.out 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:258 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:258.out 2024-06-13T11:39:43.098 INFO:teuthology.orchestra.run.smithi043.stdout:259 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:259.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:260 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:260.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:261 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:261.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:262 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:262.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:263 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:263.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:264 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:264.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:265 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:265.out 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:266 2024-06-13T11:39:43.099 INFO:teuthology.orchestra.run.smithi043.stdout:266.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:267 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:267.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:268 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:268.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:269 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:269.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:270 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:270.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:271 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:271.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:272 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:272.out 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:273 2024-06-13T11:39:43.100 INFO:teuthology.orchestra.run.smithi043.stdout:273.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:274 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:274.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:275 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:275.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:276 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:276.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:277 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:277.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:278 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:278.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:279 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:279.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:280 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:280.out 2024-06-13T11:39:43.101 INFO:teuthology.orchestra.run.smithi043.stdout:281 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:281.out 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:282 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:282.out 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:283 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:283.out 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:284 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:284.out 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:285 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:285.out 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:286 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:286.out 2024-06-13T11:39:43.102 INFO:teuthology.orchestra.run.smithi043.stdout:287 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:287.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:288 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:288.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:289 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:289.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:290 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:290.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:291 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:291.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:292 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:292.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:293 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:293.out 2024-06-13T11:39:43.103 INFO:teuthology.orchestra.run.smithi043.stdout:294 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:294.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:295 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:295.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:296 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:296.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:297 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:297.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:298 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:298.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:299 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:299.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:300 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:300.out 2024-06-13T11:39:43.104 INFO:teuthology.orchestra.run.smithi043.stdout:301 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:301.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:302 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:302.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:303 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:303.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:304 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:304.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:305 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:305.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:306 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:306.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:307 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:307.out 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:308 2024-06-13T11:39:43.105 INFO:teuthology.orchestra.run.smithi043.stdout:308.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:309 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:309.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:310 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:310.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:311 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:311.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:312 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:312.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:313 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:313.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:314 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:314.out 2024-06-13T11:39:43.106 INFO:teuthology.orchestra.run.smithi043.stdout:315 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:315.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:316 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:316.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:317 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:317.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:318 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:318.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:319 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:319.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:320 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:320.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:321 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:321.out 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:322 2024-06-13T11:39:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:322.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:323 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:323.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:324 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:324.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:325 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:325.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:326 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:326.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:327 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:327.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:328 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:328.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:329 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:329.out 2024-06-13T11:39:43.108 INFO:teuthology.orchestra.run.smithi043.stdout:330 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:330.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:331 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:331.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:332 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:332.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:333 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:333.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:334 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:334.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:335 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:335.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:336 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:336.out 2024-06-13T11:39:43.109 INFO:teuthology.orchestra.run.smithi043.stdout:337 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:337.out 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:338 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:338.out 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:339 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:339.out 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:340 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:340.out 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:341 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:341.out 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:342 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:342.out 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:343 2024-06-13T11:39:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:343.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:344 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:344.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:345 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:345.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:346 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:346.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:347 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:347.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:348 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:348.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:349 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:349.out 2024-06-13T11:39:43.111 INFO:teuthology.orchestra.run.smithi043.stdout:350 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:350.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:351 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:351.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:352 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:352.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:353 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:353.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:354 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:354.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:355 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:355.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:356 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:356.out 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:357 2024-06-13T11:39:43.112 INFO:teuthology.orchestra.run.smithi043.stdout:357.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:358 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:358.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:359 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:359.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:360 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:360.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:361 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:361.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:371 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:371.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:372 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:372.out 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:373 2024-06-13T11:39:43.113 INFO:teuthology.orchestra.run.smithi043.stdout:373.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:374 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:374.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:375 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:375.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:376 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:376.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:377 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:377.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:378 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:378.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:379 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:379.out 2024-06-13T11:39:43.114 INFO:teuthology.orchestra.run.smithi043.stdout:380 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:380.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:381 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:381.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:382 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:382.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:383 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:383.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:384 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:384.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:385 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:385.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:386 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:386.out 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:387 2024-06-13T11:39:43.115 INFO:teuthology.orchestra.run.smithi043.stdout:387.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:388 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:388.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:389 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:389.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:390 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:390.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:391 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:391.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:392 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:392.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:393 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:393.out 2024-06-13T11:39:43.116 INFO:teuthology.orchestra.run.smithi043.stdout:394 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:394.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:395 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:395.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:396 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:396.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:397 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:397.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:398 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:398.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:399 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:399.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:400 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:400.out 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:401 2024-06-13T11:39:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:401.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:402 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:402.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:403 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:403.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:404 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:404.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:405 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:405.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:406 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:406.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:407 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:407.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:408 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:408.out 2024-06-13T11:39:43.118 INFO:teuthology.orchestra.run.smithi043.stdout:409 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:409.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:410 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:410.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:411 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:411.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:412 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:412.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:413 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:413.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:414 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:414.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:415 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:415.out 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:416 2024-06-13T11:39:43.119 INFO:teuthology.orchestra.run.smithi043.stdout:416.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:417 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:417.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:418 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:418.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:419 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:419.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:420 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:420.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:421 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:421.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:422 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:422.out 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:423 2024-06-13T11:39:43.120 INFO:teuthology.orchestra.run.smithi043.stdout:423.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:424 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:424.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:425 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:425.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:426 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:426.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:427 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:427.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:428 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:428.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:429 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:429.out 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:430 2024-06-13T11:39:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:430.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:431 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:431.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:432 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:432.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:433 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:433.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:434 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:434.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:435 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:435.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:436 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:436.out 2024-06-13T11:39:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:437 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:437.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:438 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:438.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:439 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:439.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:440 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:440.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:441 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:441.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:442 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:442.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:443 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:443.out 2024-06-13T11:39:43.123 INFO:teuthology.orchestra.run.smithi043.stdout:444 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:444.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:445 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:445.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:446 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:446.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:447 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:447.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:448 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:448.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:449 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:449.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:450 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:450.out 2024-06-13T11:39:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:451 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:451.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:452 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:452.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:453 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:453.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:454 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:454.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:455 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:455.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:456 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:456.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:457 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:457.out 2024-06-13T11:39:43.125 INFO:teuthology.orchestra.run.smithi043.stdout:458 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:458.out 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:459 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:459.out 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:460 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:460.out 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:461 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:461.out 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:462 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:462.out 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:463 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:463.out 2024-06-13T11:39:43.126 INFO:teuthology.orchestra.run.smithi043.stdout:464 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:464.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:465 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:465.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:466 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:466.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:467 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:467.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:468 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:468.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:469 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:469.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:470 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:470.out 2024-06-13T11:39:43.127 INFO:teuthology.orchestra.run.smithi043.stdout:471 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:471.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:472 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:472.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:473 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:473.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:474 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:474.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:475 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:475.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:476 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:476.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:477 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:477.out 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:478 2024-06-13T11:39:43.128 INFO:teuthology.orchestra.run.smithi043.stdout:478.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:479 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:479.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:480 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:480.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:481 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:481.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:482 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:482.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:483 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:483.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:484 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:484.out 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:485 2024-06-13T11:39:43.129 INFO:teuthology.orchestra.run.smithi043.stdout:485.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:486 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:486.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:487 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:487.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:488 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:488.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:489 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:489.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:490 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:490.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:491 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:491.out 2024-06-13T11:39:43.130 INFO:teuthology.orchestra.run.smithi043.stdout:492 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:492.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:493 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:493.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:494 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:494.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:495 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:495.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:496 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:496.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:497 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:497.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:498 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:498.out 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:499 2024-06-13T11:39:43.131 INFO:teuthology.orchestra.run.smithi043.stdout:499.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:500 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:500.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:501 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:501.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:502 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:502.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:503 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:503.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:504 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:504.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:505 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:505.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:506 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:506.out 2024-06-13T11:39:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:507 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:507.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:508 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:508.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:509 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:509.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:510 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:510.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:511 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:511.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:512 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:512.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:513 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:513.out 2024-06-13T11:39:43.133 INFO:teuthology.orchestra.run.smithi043.stdout:514 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:514.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:515 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:515.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:516 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:516.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:517 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:517.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:518 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:518.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:519 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:519.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:520 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:520.out 2024-06-13T11:39:43.134 INFO:teuthology.orchestra.run.smithi043.stdout:521 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:521.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:522 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:522.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:523 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:523.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:524 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:524.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:525 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:525.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:526 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:526.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:527 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:527.out 2024-06-13T11:39:43.135 INFO:teuthology.orchestra.run.smithi043.stdout:528 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:528.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:529 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:529.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:530 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:530.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:531 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:531.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:532 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:532.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:533 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:533.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:534 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:534.out 2024-06-13T11:39:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:535 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:535.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:536 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:536.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:537 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:537.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:538 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:538.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:539 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:539.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:540 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:540.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:541 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:541.out 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:542 2024-06-13T11:39:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:542.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:543 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:543.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:544 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:544.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:545 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:545.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:546 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:546.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:547 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:547.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:548 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:548.out 2024-06-13T11:39:43.138 INFO:teuthology.orchestra.run.smithi043.stdout:549 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:549.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:550 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:550.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:551 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:551.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:552 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:552.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:553 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:553.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:554 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:554.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:555 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:555.out 2024-06-13T11:39:43.139 INFO:teuthology.orchestra.run.smithi043.stdout:556 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:556.out 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:557 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:557.out 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:558 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:558.out 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:559 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:559.out 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:560 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:560.out 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:561 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:561.out 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:562 2024-06-13T11:39:43.140 INFO:teuthology.orchestra.run.smithi043.stdout:562.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:563 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:563.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:564 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:564.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:565 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:565.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:566 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:566.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:567 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:567.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:568 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:568.out 2024-06-13T11:39:43.141 INFO:teuthology.orchestra.run.smithi043.stdout:569 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:569.out 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:570 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:570.out 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:571 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:571.out 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:572 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:572.out 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:573 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:573.out 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:574 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:574.out 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:575 2024-06-13T11:39:43.142 INFO:teuthology.orchestra.run.smithi043.stdout:575.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:576 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:576.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:577 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:577.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:578 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:578.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:579 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:579.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:580 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:580.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:581 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:581.out 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:582 2024-06-13T11:39:43.143 INFO:teuthology.orchestra.run.smithi043.stdout:582.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:583 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:583.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:584 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:584.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:585 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:585.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:586 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:586.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:587 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:587.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:588 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:588.out 2024-06-13T11:39:43.144 INFO:teuthology.orchestra.run.smithi043.stdout:589 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:589.out 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:590 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:590.out 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:591 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:591.out 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:592 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:592.out 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:593 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:593.out 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:594 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:594.out 2024-06-13T11:39:43.145 INFO:teuthology.orchestra.run.smithi043.stdout:595 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:595.out 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:596 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:596.out 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:597 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:597.out 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:598 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:598.out 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:599 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:599.out 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:600 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:600.out 2024-06-13T11:39:43.146 INFO:teuthology.orchestra.run.smithi043.stdout:601 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:601.out 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:602 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:602.out 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:603 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:603.out 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:604 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:604.out 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:605 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:605.out 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:606 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:606.out 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:607 2024-06-13T11:39:43.147 INFO:teuthology.orchestra.run.smithi043.stdout:607.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:608 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:608.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:609 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:609.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:610 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:610.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:611 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:611.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:612 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:612.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:613 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:613.out 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:614 2024-06-13T11:39:43.148 INFO:teuthology.orchestra.run.smithi043.stdout:614.out 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:615 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:615.out 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:616 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:616.out 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:617 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:617.out 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:618 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:618.out 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:619 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:619.out 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:620 2024-06-13T11:39:43.149 INFO:teuthology.orchestra.run.smithi043.stdout:620.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:621 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:621.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:622 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:622.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:623 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:623.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:624 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:624.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:625 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:625.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:626 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:626.out 2024-06-13T11:39:43.150 INFO:teuthology.orchestra.run.smithi043.stdout:627 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:627.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:628 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:628.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:629 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:629.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:630 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:630.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:631 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:631.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:632 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:632.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:633 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:633.out 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:634 2024-06-13T11:39:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:634.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:635 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:635.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:636 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:636.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:637 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:637.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:638 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:638.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:639 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:639.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:640 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:640.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:641 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:641.out 2024-06-13T11:39:43.152 INFO:teuthology.orchestra.run.smithi043.stdout:642 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:642.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:643 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:643.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:644 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:644.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:645 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:645.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:646 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:646.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:647 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:647.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:648 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:648.out 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:649 2024-06-13T11:39:43.153 INFO:teuthology.orchestra.run.smithi043.stdout:649.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:650 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:650.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:651 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:651.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:652 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:652.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:653 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:653.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:654 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:654.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:655 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:655.out 2024-06-13T11:39:43.154 INFO:teuthology.orchestra.run.smithi043.stdout:656 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:656.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:657 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:657.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:658 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:658.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:659 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:659.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:660 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:660.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:661 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:661.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:662 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:662.out 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:663 2024-06-13T11:39:43.155 INFO:teuthology.orchestra.run.smithi043.stdout:663.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:664 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:664.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:665 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:665.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:666 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:666.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:667 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:667.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:668 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:668.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:669 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:669.out 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:670 2024-06-13T11:39:43.156 INFO:teuthology.orchestra.run.smithi043.stdout:670.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:671 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:671.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:672 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:672.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:673 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:673.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:674 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:674.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:675 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:675.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:676 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:676.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:677 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:677.out 2024-06-13T11:39:43.157 INFO:teuthology.orchestra.run.smithi043.stdout:678 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:678.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:679 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:679.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:680 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:680.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:681 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:681.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:682 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:682.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:683 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:683.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:684 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:684.out 2024-06-13T11:39:43.158 INFO:teuthology.orchestra.run.smithi043.stdout:685 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:685.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:686 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:686.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:687 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:687.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:688 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:688.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:689 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:689.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:690 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:690.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:691 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:691.out 2024-06-13T11:39:43.159 INFO:teuthology.orchestra.run.smithi043.stdout:692 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:692.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:693 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:693.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:694 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:694.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:695 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:695.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:696 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:696.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:697 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:697.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:698 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:698.out 2024-06-13T11:39:43.160 INFO:teuthology.orchestra.run.smithi043.stdout:699 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:699.out 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:700 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:700.out 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:701 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:701.out 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:702 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:702.out 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:703 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:703.out 2024-06-13T11:39:43.161 INFO:teuthology.orchestra.run.smithi043.stdout:704 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:704.out 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:705 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:705.out 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:706 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:706.out 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:707 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:707.out 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:708 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:708.out 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:709 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:709.out 2024-06-13T11:39:43.162 INFO:teuthology.orchestra.run.smithi043.stdout:710 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:710.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:711 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:711.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:712 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:712.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:713 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:713.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:714 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:714.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:715 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:715.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:716 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:716.out 2024-06-13T11:39:43.163 INFO:teuthology.orchestra.run.smithi043.stdout:717 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:717.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:718 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:718.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:719 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:719.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:720 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:720.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:721 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:721.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:722 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:722.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:723 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:723.out 2024-06-13T11:39:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:724 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:724.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:725 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:725.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:726 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:726.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:727 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:727.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:728 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:728.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:729 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:729.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:730 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:730.out 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:731 2024-06-13T11:39:43.165 INFO:teuthology.orchestra.run.smithi043.stdout:731.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:732 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:732.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:733 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:733.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:734 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:734.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:735 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:735.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:736 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:736.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:737 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:737.out 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:738 2024-06-13T11:39:43.166 INFO:teuthology.orchestra.run.smithi043.stdout:738.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:739 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:739.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:740 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:740.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:741 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:741.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:742 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:742.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:743 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:743.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:744 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:744.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:745 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:745.out 2024-06-13T11:39:43.167 INFO:teuthology.orchestra.run.smithi043.stdout:746 2024-06-13T11:39:43.168 INFO:teuthology.orchestra.run.smithi043.stdout:746.out 2024-06-13T11:39:43.168 INFO:teuthology.orchestra.run.smithi043.stdout:747 2024-06-13T11:39:43.168 INFO:teuthology.orchestra.run.smithi043.stdout:747.out 2024-06-13T11:39:43.168 INFO:teuthology.orchestra.run.smithi043.stdout:group.list 2024-06-13T11:39:43.168 INFO:teuthology.orchestra.run.smithi043.stdout:Makefile 2024-06-13T11:39:43.168 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-06-13T11:39:43.362 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:39:43.366 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:39:43.366 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:39:43.367 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:39:43.367 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:43.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:39:43.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:39:49.385 INFO:teuthology.orchestra.run.smithi043.stdout:generic/001 6s 2024-06-13T11:39:49.392 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/001 2024-06-13T11:39:49.392 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:39:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:49.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:39:49.448 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-06-13T11:39:49.741 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:39:49.745 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:39:49.746 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:39:49.747 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:39:49.747 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:50.119 INFO:teuthology.orchestra.run.smithi043.stdout:generic/002 1s 2024-06-13T11:39:50.126 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/002 2024-06-13T11:39:50.126 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:39:50.128 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:50.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:39:50.163 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-06-13T11:39:50.357 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:39:50.361 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:39:50.361 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:39:50.362 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:39:50.362 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:50.592 INFO:teuthology.orchestra.run.smithi043.stdout:generic/003 [not run] atime not maintained by ceph 2024-06-13T11:39:50.597 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/003 2024-06-13T11:39:50.597 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/003 2024-06-13T11:39:50.597 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:39:50.600 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:50.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:39:50.611 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-06-13T11:39:50.800 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:39:50.804 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:39:50.804 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:39:50.805 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:39:50.805 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:51.022 INFO:teuthology.orchestra.run.smithi043.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-06-13T11:39:51.027 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/004 2024-06-13T11:39:51.027 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/004 2024-06-13T11:39:51.028 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:39:51.030 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:51.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:39:51.041 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-06-13T11:39:51.219 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:39:51.223 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:39:51.223 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:39:51.224 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:39:51.224 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:51.605 INFO:teuthology.orchestra.run.smithi043.stdout:generic/005 0s 2024-06-13T11:39:51.612 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/005 2024-06-13T11:39:51.612 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:39:51.614 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:39:51.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:39:51.654 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-06-13T11:39:51.836 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:39:51.840 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:39:51.840 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:39:51.841 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:39:51.841 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:40:14.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:40:14.043 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:40:18.066 INFO:teuthology.orchestra.run.smithi043.stdout:generic/006 27s 2024-06-13T11:40:18.079 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/006 2024-06-13T11:40:18.079 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:40:18.082 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:40:18.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:40:18.142 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-06-13T11:40:18.339 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:40:18.343 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:40:18.343 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:40:18.344 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:40:18.344 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:40:44.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:40:44.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:41:11.281 INFO:teuthology.orchestra.run.smithi043.stdout:generic/007 53s 2024-06-13T11:41:11.297 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/007 2024-06-13T11:41:11.297 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:41:11.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:11.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:41:11.379 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-06-13T11:41:11.580 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:41:11.584 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:41:11.584 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:41:11.585 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:41:11.585 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:11.842 INFO:teuthology.orchestra.run.smithi043.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-06-13T11:41:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/008 2024-06-13T11:41:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/008 2024-06-13T11:41:11.847 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:41:11.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:11.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:41:11.864 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-06-13T11:41:12.047 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:41:12.051 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:41:12.051 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:41:12.052 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:41:12.052 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:12.335 INFO:teuthology.orchestra.run.smithi043.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-06-13T11:41:12.340 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/009 2024-06-13T11:41:12.340 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/009 2024-06-13T11:41:12.340 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:41:12.343 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:12.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:41:12.358 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-06-13T11:41:12.541 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:41:12.545 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:41:12.545 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:41:12.546 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:41:12.546 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:13.097 INFO:teuthology.orchestra.run.smithi043.stdout:generic/010 1s 2024-06-13T11:41:13.104 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/010 2024-06-13T11:41:13.104 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:41:13.106 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:13.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:41:13.135 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-06-13T11:41:13.343 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:41:13.347 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:41:13.347 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:41:13.348 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:41:13.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:14.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:41:14.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:41:42.880 INFO:teuthology.orchestra.run.smithi043.stdout:generic/011 29s 2024-06-13T11:41:42.886 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/011 2024-06-13T11:41:42.886 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:41:42.888 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:42.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:41:42.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-06-13T11:41:43.132 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:41:43.136 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:41:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:41:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:41:43.137 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:43.419 INFO:teuthology.orchestra.run.smithi043.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:41:43.424 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/012 2024-06-13T11:41:43.424 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/012 2024-06-13T11:41:43.424 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:41:43.427 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:43.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:41:43.477 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-06-13T11:41:43.709 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:41:43.713 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:41:43.713 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:41:43.714 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:41:43.714 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:41:44.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:41:44.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:42:14.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:42:14.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:42:36.571 INFO:teuthology.orchestra.run.smithi043.stdout:generic/013 53s 2024-06-13T11:42:36.580 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/013 2024-06-13T11:42:36.580 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:36.583 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:36.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:36.606 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-06-13T11:42:36.865 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:36.871 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:36.871 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:36.873 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:36.873 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:37.200 INFO:teuthology.orchestra.run.smithi043.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-06-13T11:42:37.206 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/014 2024-06-13T11:42:37.207 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/014 2024-06-13T11:42:37.207 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:37.210 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:37.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:37.231 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-06-13T11:42:37.480 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:37.487 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:37.488 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:37.489 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:37.489 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:37.786 INFO:teuthology.orchestra.run.smithi043.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T11:42:37.793 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/015 2024-06-13T11:42:37.793 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/015 2024-06-13T11:42:37.794 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:37.797 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:37.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:37.813 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-06-13T11:42:38.077 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:38.083 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:38.084 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:38.085 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:38.085 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:38.474 INFO:teuthology.orchestra.run.smithi043.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:42:38.480 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/016 2024-06-13T11:42:38.480 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/016 2024-06-13T11:42:38.480 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:38.484 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:38.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:38.518 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-06-13T11:42:38.833 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:38.838 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:38.839 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:38.840 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:38.840 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:39.166 INFO:teuthology.orchestra.run.smithi043.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-06-13T11:42:39.173 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/017 2024-06-13T11:42:39.174 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/017 2024-06-13T11:42:39.174 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:39.177 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:39.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:39.192 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-06-13T11:42:39.449 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:39.454 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:39.455 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:39.457 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:39.457 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:39.829 INFO:teuthology.orchestra.run.smithi043.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-06-13T11:42:39.842 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/018 2024-06-13T11:42:39.843 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/018 2024-06-13T11:42:39.843 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:39.845 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:39.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:39.862 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-06-13T11:42:40.090 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:40.095 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:40.096 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:40.097 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:40.097 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:40.378 INFO:teuthology.orchestra.run.smithi043.stdout:generic/019 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:42:40.385 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/019 2024-06-13T11:42:40.385 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/019 2024-06-13T11:42:40.385 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:40.389 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:40.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:40.405 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-06-13T11:42:40.663 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:40.668 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:40.668 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:40.669 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:40.670 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:44.079 INFO:teuthology.orchestra.run.smithi043.stdout:generic/020 3s 2024-06-13T11:42:44.129 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/020 2024-06-13T11:42:44.129 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:44.132 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:44.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:44.170 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-06-13T11:42:44.472 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:44.478 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:44.478 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:44.479 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:44.480 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:44.874 INFO:teuthology.orchestra.run.smithi043.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:42:44.881 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/021 2024-06-13T11:42:44.881 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/021 2024-06-13T11:42:44.881 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:44.885 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:44.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:44.919 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-06-13T11:42:45.017 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:42:45.021 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:42:45.242 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:45.249 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:45.250 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:45.251 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:45.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:45.632 INFO:teuthology.orchestra.run.smithi043.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:42:45.638 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/022 2024-06-13T11:42:45.639 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/022 2024-06-13T11:42:45.639 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:45.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:45.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:45.670 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-06-13T11:42:45.999 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:46.005 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:46.005 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:46.007 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:46.007 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:47.301 INFO:teuthology.orchestra.run.smithi043.stdout:generic/023 1s 2024-06-13T11:42:47.310 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/023 2024-06-13T11:42:47.310 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:47.313 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:47.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:47.418 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-06-13T11:42:47.690 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:47.696 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:47.697 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:47.698 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:47.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:48.012 INFO:teuthology.orchestra.run.smithi043.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-06-13T11:42:48.019 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/024 2024-06-13T11:42:48.019 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/024 2024-06-13T11:42:48.019 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:48.023 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:48.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:48.060 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-06-13T11:42:48.374 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:48.379 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:48.380 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:48.381 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:48.381 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:48.695 INFO:teuthology.orchestra.run.smithi043.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-06-13T11:42:48.702 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/025 2024-06-13T11:42:48.702 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/025 2024-06-13T11:42:48.702 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:48.706 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:48.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:48.738 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-06-13T11:42:49.060 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:49.066 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:49.066 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:49.068 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:49.068 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:49.392 INFO:teuthology.orchestra.run.smithi043.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-06-13T11:42:49.400 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/026 2024-06-13T11:42:49.401 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/026 2024-06-13T11:42:49.401 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:49.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:49.427 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-06-13T11:42:49.684 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:49.690 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:49.690 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:49.692 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:49.692 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:49.973 INFO:teuthology.orchestra.run.smithi043.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T11:42:49.981 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/027 2024-06-13T11:42:49.981 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/027 2024-06-13T11:42:49.981 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:49.984 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:49.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:49.998 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-06-13T11:42:50.248 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:50.253 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:50.254 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:50.255 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:50.255 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:55.556 INFO:teuthology.orchestra.run.smithi043.stdout:generic/028 5s 2024-06-13T11:42:55.566 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/028 2024-06-13T11:42:55.566 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:42:55.570 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:42:55.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:42:55.594 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-06-13T11:42:55.842 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:42:55.847 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:42:55.847 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:42:55.849 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:42:55.849 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:00.110 INFO:teuthology.orchestra.run.smithi043.stdout:generic/029 5s 2024-06-13T11:43:00.236 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/029 2024-06-13T11:43:00.236 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:00.239 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:00.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:00.253 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-06-13T11:43:00.509 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:00.514 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:00.514 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:00.515 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:00.516 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:01.866 INFO:teuthology.orchestra.run.smithi043.stdout:generic/030 1s 2024-06-13T11:43:01.876 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/030 2024-06-13T11:43:01.876 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:01.879 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:01.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:01.891 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-06-13T11:43:02.147 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:02.153 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:02.153 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:02.156 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:02.156 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:02.517 INFO:teuthology.orchestra.run.smithi043.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-06-13T11:43:02.524 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/031 2024-06-13T11:43:02.524 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/031 2024-06-13T11:43:02.524 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:02.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:02.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:02.550 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-06-13T11:43:02.798 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:02.804 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:02.805 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:02.806 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:03.109 INFO:teuthology.orchestra.run.smithi043.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:43:03.117 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/032 2024-06-13T11:43:03.117 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/032 2024-06-13T11:43:03.117 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:03.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:03.138 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-06-13T11:43:03.390 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:03.396 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:03.397 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:03.399 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:03.758 INFO:teuthology.orchestra.run.smithi043.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-06-13T11:43:03.764 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/033 2024-06-13T11:43:03.765 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/033 2024-06-13T11:43:03.765 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:03.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:03.790 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-06-13T11:43:04.045 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:04.050 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:04.050 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:04.051 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:04.051 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:04.357 INFO:teuthology.orchestra.run.smithi043.stdout:generic/034 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:04.363 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/034 2024-06-13T11:43:04.363 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/034 2024-06-13T11:43:04.364 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:04.366 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:04.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:04.382 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-06-13T11:43:04.633 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:04.639 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:04.640 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:04.641 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:04.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:05.010 INFO:teuthology.orchestra.run.smithi043.stdout:generic/035 1s 2024-06-13T11:43:05.017 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/035 2024-06-13T11:43:05.017 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:05.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:05.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:05.054 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-06-13T11:43:05.378 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:05.383 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:05.384 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:05.385 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:05.385 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:15.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:43:15.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:43:15.771 INFO:teuthology.orchestra.run.smithi043.stdout:generic/036 10s 2024-06-13T11:43:15.781 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/036 2024-06-13T11:43:15.781 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:15.786 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:15.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:15.827 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-06-13T11:43:16.147 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:16.151 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:16.152 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:16.153 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:16.153 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:20.629 INFO:teuthology.orchestra.run.smithi043.stdout:generic/037 4s 2024-06-13T11:43:20.637 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/037 2024-06-13T11:43:20.637 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:20.640 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:20.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:20.650 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-06-13T11:43:20.920 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:20.925 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:20.925 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:20.926 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:20.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:21.220 INFO:teuthology.orchestra.run.smithi043.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:43:21.226 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/038 2024-06-13T11:43:21.226 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/038 2024-06-13T11:43:21.227 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:21.230 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:21.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:21.249 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-06-13T11:43:21.501 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:21.506 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:21.506 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:21.507 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:21.508 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:21.820 INFO:teuthology.orchestra.run.smithi043.stdout:generic/039 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:21.826 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/039 2024-06-13T11:43:21.827 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/039 2024-06-13T11:43:21.827 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:21.829 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:21.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:21.855 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-06-13T11:43:22.128 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:22.134 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:22.135 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:22.136 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:22.136 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:22.447 INFO:teuthology.orchestra.run.smithi043.stdout:generic/040 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:22.453 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/040 2024-06-13T11:43:22.453 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/040 2024-06-13T11:43:22.453 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:22.456 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:22.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:22.476 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-06-13T11:43:22.735 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:22.741 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:22.742 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:22.743 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:22.743 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:23.064 INFO:teuthology.orchestra.run.smithi043.stdout:generic/041 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:23.072 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/041 2024-06-13T11:43:23.072 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/041 2024-06-13T11:43:23.072 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:23.075 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:23.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:23.097 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-06-13T11:43:23.346 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:23.352 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:23.353 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:23.354 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:23.355 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:23.737 INFO:teuthology.orchestra.run.smithi043.stdout:generic/042 [not run] ceph does not support shutdown 2024-06-13T11:43:23.750 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/042 2024-06-13T11:43:23.750 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/042 2024-06-13T11:43:23.750 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:23.752 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:23.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:23.769 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-06-13T11:43:24.024 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:24.030 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:24.030 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:24.031 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:24.031 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:24.416 INFO:teuthology.orchestra.run.smithi043.stdout:generic/043 [not run] ceph does not support shutdown 2024-06-13T11:43:24.428 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/043 2024-06-13T11:43:24.428 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/043 2024-06-13T11:43:24.428 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:24.431 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:24.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:24.446 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-06-13T11:43:24.706 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:24.711 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:24.712 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:24.713 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:24.713 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:25.105 INFO:teuthology.orchestra.run.smithi043.stdout:generic/044 [not run] ceph does not support shutdown 2024-06-13T11:43:25.117 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/044 2024-06-13T11:43:25.117 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/044 2024-06-13T11:43:25.117 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:25.120 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:25.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:25.137 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-06-13T11:43:25.393 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:25.403 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:25.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:25.786 INFO:teuthology.orchestra.run.smithi043.stdout:generic/045 [not run] ceph does not support shutdown 2024-06-13T11:43:25.797 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/045 2024-06-13T11:43:25.797 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/045 2024-06-13T11:43:25.797 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:25.800 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:25.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:25.815 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-06-13T11:43:26.079 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:26.084 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:26.085 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:26.086 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:26.086 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:26.460 INFO:teuthology.orchestra.run.smithi043.stdout:generic/046 [not run] ceph does not support shutdown 2024-06-13T11:43:26.481 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/046 2024-06-13T11:43:26.481 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/046 2024-06-13T11:43:26.481 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:26.484 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:26.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:26.497 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-06-13T11:43:26.764 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:26.770 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:26.770 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:26.772 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:26.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:27.155 INFO:teuthology.orchestra.run.smithi043.stdout:generic/047 [not run] ceph does not support shutdown 2024-06-13T11:43:27.172 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/047 2024-06-13T11:43:27.172 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/047 2024-06-13T11:43:27.172 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:27.175 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:27.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:27.191 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-06-13T11:43:27.423 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:27.428 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:27.429 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:27.430 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:27.430 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:27.828 INFO:teuthology.orchestra.run.smithi043.stdout:generic/048 [not run] ceph does not support shutdown 2024-06-13T11:43:27.845 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/048 2024-06-13T11:43:27.845 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/048 2024-06-13T11:43:27.845 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:27.848 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:27.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:27.864 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-06-13T11:43:28.129 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:28.135 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:28.136 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:28.137 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:28.137 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:28.518 INFO:teuthology.orchestra.run.smithi043.stdout:generic/049 [not run] ceph does not support shutdown 2024-06-13T11:43:28.527 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/049 2024-06-13T11:43:28.527 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/049 2024-06-13T11:43:28.527 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:28.531 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:28.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:28.546 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-06-13T11:43:28.810 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:28.816 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:28.816 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:28.817 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:28.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:29.193 INFO:teuthology.orchestra.run.smithi043.stdout:generic/050 [not run] ceph does not support shutdown 2024-06-13T11:43:29.208 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/050 2024-06-13T11:43:29.209 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/050 2024-06-13T11:43:29.209 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:29.211 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:29.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:29.226 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-06-13T11:43:29.484 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:29.489 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:29.489 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:29.490 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:29.490 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:29.867 INFO:teuthology.orchestra.run.smithi043.stdout:generic/051 [not run] ceph does not support shutdown 2024-06-13T11:43:29.874 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/051 2024-06-13T11:43:29.874 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/051 2024-06-13T11:43:29.874 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:29.878 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:29.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:29.897 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-06-13T11:43:30.145 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:30.150 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:30.151 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:30.154 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:30.154 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:30.529 INFO:teuthology.orchestra.run.smithi043.stdout:generic/052 [not run] ceph does not support shutdown 2024-06-13T11:43:30.539 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/052 2024-06-13T11:43:30.539 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/052 2024-06-13T11:43:30.540 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:30.543 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:30.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:30.558 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-06-13T11:43:30.815 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:30.820 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:30.820 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:30.821 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:30.821 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:31.473 INFO:teuthology.orchestra.run.smithi043.stdout:generic/053 1s 2024-06-13T11:43:31.492 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/053 2024-06-13T11:43:31.492 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:31.494 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:31.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:31.520 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-06-13T11:43:31.781 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:31.786 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:31.787 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:31.788 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:31.788 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:32.188 INFO:teuthology.orchestra.run.smithi043.stdout:generic/054 [not run] ceph does not support shutdown 2024-06-13T11:43:32.211 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/054 2024-06-13T11:43:32.211 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/054 2024-06-13T11:43:32.211 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:32.214 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:32.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:32.229 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-06-13T11:43:32.487 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:32.493 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:32.494 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:32.495 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:32.495 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:32.871 INFO:teuthology.orchestra.run.smithi043.stdout:generic/055 [not run] ceph does not support shutdown 2024-06-13T11:43:32.881 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/055 2024-06-13T11:43:32.882 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/055 2024-06-13T11:43:32.882 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:32.887 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:32.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:32.905 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-06-13T11:43:33.148 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:33.154 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:33.155 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:33.157 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:33.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:33.484 INFO:teuthology.orchestra.run.smithi043.stdout:generic/056 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:33.491 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/056 2024-06-13T11:43:33.491 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/056 2024-06-13T11:43:33.491 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:33.494 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:33.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:33.514 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-06-13T11:43:33.760 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:33.765 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:33.765 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:33.766 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:33.766 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:34.079 INFO:teuthology.orchestra.run.smithi043.stdout:generic/057 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:34.086 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/057 2024-06-13T11:43:34.086 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/057 2024-06-13T11:43:34.086 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:34.089 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:34.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:34.112 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-06-13T11:43:34.364 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:34.370 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:34.370 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:34.372 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:34.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:34.769 INFO:teuthology.orchestra.run.smithi043.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:43:34.776 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/058 2024-06-13T11:43:34.776 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/058 2024-06-13T11:43:34.777 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:34.782 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:34.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:34.820 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-06-13T11:43:35.166 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:35.170 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:35.171 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:35.172 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:35.172 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:35.461 INFO:teuthology.orchestra.run.smithi043.stdout:generic/059 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:35.468 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/059 2024-06-13T11:43:35.468 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/059 2024-06-13T11:43:35.468 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:35.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:35.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:35.489 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-06-13T11:43:35.753 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:35.760 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:35.761 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:35.762 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:35.762 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:36.157 INFO:teuthology.orchestra.run.smithi043.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:43:36.164 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/060 2024-06-13T11:43:36.164 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/060 2024-06-13T11:43:36.164 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:36.169 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:36.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:36.209 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-06-13T11:43:36.543 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:36.549 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:36.549 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:36.550 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:36.550 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:36.915 INFO:teuthology.orchestra.run.smithi043.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:43:36.922 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/061 2024-06-13T11:43:36.922 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/061 2024-06-13T11:43:36.922 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:36.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:36.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:36.962 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-06-13T11:43:37.299 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:37.304 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:37.304 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:37.306 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:37.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:39.072 INFO:teuthology.orchestra.run.smithi043.stdout:generic/062 2s 2024-06-13T11:43:39.085 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/062 2024-06-13T11:43:39.085 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:39.089 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:39.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:39.105 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-06-13T11:43:39.375 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:39.381 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:39.382 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:39.382 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:39.858 INFO:teuthology.orchestra.run.smithi043.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:43:39.864 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/063 2024-06-13T11:43:39.865 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/063 2024-06-13T11:43:39.865 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:39.868 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:39.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:39.917 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-06-13T11:43:40.244 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:40.251 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:40.252 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:40.253 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:40.253 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:40.555 INFO:teuthology.orchestra.run.smithi043.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-06-13T11:43:40.561 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/064 2024-06-13T11:43:40.561 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/064 2024-06-13T11:43:40.561 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:40.565 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:40.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:40.584 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-06-13T11:43:40.845 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:40.849 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:40.850 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:40.851 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:40.852 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:41.174 INFO:teuthology.orchestra.run.smithi043.stdout:generic/065 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/065 2024-06-13T11:43:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/065 2024-06-13T11:43:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:41.183 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:41.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:41.208 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-06-13T11:43:41.470 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:41.476 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:41.477 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:41.478 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:41.479 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:41.774 INFO:teuthology.orchestra.run.smithi043.stdout:generic/066 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:41.780 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/066 2024-06-13T11:43:41.780 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/066 2024-06-13T11:43:41.780 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:41.784 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:41.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:41.801 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-06-13T11:43:42.048 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:42.052 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:42.053 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:42.054 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:42.054 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:42.379 INFO:teuthology.orchestra.run.smithi043.stdout:generic/067 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:43:42.385 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/067 2024-06-13T11:43:42.385 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/067 2024-06-13T11:43:42.385 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:42.388 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:42.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:42.411 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-06-13T11:43:42.663 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:42.668 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:42.669 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:42.670 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:42.670 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:42.964 INFO:teuthology.orchestra.run.smithi043.stdout:generic/068 [not run] ceph does not support freezing 2024-06-13T11:43:42.970 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/068 2024-06-13T11:43:42.970 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/068 2024-06-13T11:43:42.971 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:42.973 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:43.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:43.004 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-06-13T11:43:43.268 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:43.273 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:43.274 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:43.275 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:43.275 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:45.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:43:45.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:43:51.447 INFO:teuthology.orchestra.run.smithi043.stdout:generic/069 8s 2024-06-13T11:43:51.464 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/069 2024-06-13T11:43:51.464 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:43:51.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:43:51.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:43:51.495 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-06-13T11:43:51.784 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:43:51.789 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:43:51.790 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:43:51.791 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:43:51.791 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:15.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:44:15.466 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:44:15.539 INFO:tasks.ceph.mds.d.smithi053.stderr:2024-06-13T11:44:15.539+0000 7fc687bad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44307) UID: 0 2024-06-13T11:44:15.539 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T11:44:15.539+0000 7fe599183640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44307) UID: 0 2024-06-13T11:44:18.515 INFO:teuthology.orchestra.run.smithi043.stdout:generic/070 27s 2024-06-13T11:44:18.524 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/070 2024-06-13T11:44:18.524 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:18.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:18.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:18.627 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-06-13T11:44:18.924 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:18.930 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:18.930 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:18.932 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:18.932 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:19.215 INFO:teuthology.orchestra.run.smithi043.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-06-13T11:44:19.221 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/071 2024-06-13T11:44:19.221 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/071 2024-06-13T11:44:19.221 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:19.224 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:19.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:19.244 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-06-13T11:44:19.521 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:19.526 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:19.527 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:19.528 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:19.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:19.928 INFO:teuthology.orchestra.run.smithi043.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-06-13T11:44:19.936 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/072 2024-06-13T11:44:19.936 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/072 2024-06-13T11:44:19.936 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:19.940 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:19.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:19.962 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-06-13T11:44:20.240 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:20.247 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:20.248 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:20.249 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:20.250 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:20.578 INFO:teuthology.orchestra.run.smithi043.stdout:generic/073 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:44:20.585 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/073 2024-06-13T11:44:20.585 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/073 2024-06-13T11:44:20.585 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:20.589 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:20.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:20.609 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-06-13T11:44:20.893 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:20.898 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:20.898 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:20.900 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:20.900 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:36.454 INFO:teuthology.orchestra.run.smithi043.stdout:generic/074 15s 2024-06-13T11:44:36.462 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/074 2024-06-13T11:44:36.462 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:36.465 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:37.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:37.473 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-06-13T11:44:37.781 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:37.786 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:37.787 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:37.788 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:37.788 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:58.392 INFO:teuthology.orchestra.run.smithi043.stdout:generic/075 21s 2024-06-13T11:44:58.451 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/075 2024-06-13T11:44:58.451 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:58.455 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:58.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:58.511 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-06-13T11:44:58.853 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:58.858 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:58.860 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:58.862 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:58.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:59.139 INFO:teuthology.orchestra.run.smithi043.stdout:generic/076 [not run] require 172.21.15.43:6789:/scratch to be local device 2024-06-13T11:44:59.146 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/076 2024-06-13T11:44:59.146 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/076 2024-06-13T11:44:59.146 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:44:59.150 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:44:59.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:44:59.167 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-06-13T11:44:59.465 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:44:59.469 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:44:59.470 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:44:59.471 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:44:59.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:02.683 INFO:teuthology.orchestra.run.smithi043.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T11:45:02.689 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/077 2024-06-13T11:45:02.689 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/077 2024-06-13T11:45:02.689 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:02.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:02.738 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-06-13T11:45:03.090 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:03.094 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:03.095 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:03.096 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:03.406 INFO:teuthology.orchestra.run.smithi043.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-06-13T11:45:03.412 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/078 2024-06-13T11:45:03.412 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/078 2024-06-13T11:45:03.412 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:03.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:03.456 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-06-13T11:45:03.810 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:03.816 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:03.816 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:03.817 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:04.127 INFO:teuthology.orchestra.run.smithi043.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-06-13T11:45:04.133 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/079 2024-06-13T11:45:04.133 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/079 2024-06-13T11:45:04.133 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:04.136 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:04.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:04.160 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-06-13T11:45:04.401 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:04.405 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:04.406 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:04.407 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:04.407 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:06.759 INFO:teuthology.orchestra.run.smithi043.stdout:generic/080 2s 2024-06-13T11:45:06.770 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/080 2024-06-13T11:45:06.770 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:06.773 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:06.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:06.800 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-06-13T11:45:07.039 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:07.045 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:07.045 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:07.046 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:07.046 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:07.357 INFO:teuthology.orchestra.run.smithi043.stdout:generic/081 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:45:07.366 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/081 2024-06-13T11:45:07.366 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/081 2024-06-13T11:45:07.367 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:07.370 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:07.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:07.389 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-06-13T11:45:07.647 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:07.670 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:07.670 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:07.671 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:07.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:07.942 INFO:teuthology.orchestra.run.smithi043.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T11:45:07.949 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/082 2024-06-13T11:45:07.949 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/082 2024-06-13T11:45:07.949 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:07.952 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:07.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:07.970 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-06-13T11:45:08.216 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:08.221 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:08.221 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:08.222 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:08.222 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:08.483 INFO:teuthology.orchestra.run.smithi043.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T11:45:08.490 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/083 2024-06-13T11:45:08.490 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/083 2024-06-13T11:45:08.490 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:08.493 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:08.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:08.512 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-06-13T11:45:08.777 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:08.785 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:08.786 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:08.791 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:08.791 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:14.322 INFO:teuthology.orchestra.run.smithi043.stdout:generic/084 6s 2024-06-13T11:45:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/084 2024-06-13T11:45:14.336 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:14.339 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:14.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:14.353 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-06-13T11:45:14.632 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:14.636 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:14.637 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:14.638 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:14.927 INFO:teuthology.orchestra.run.smithi043.stdout:generic/085 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:45:14.933 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/085 2024-06-13T11:45:14.934 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/085 2024-06-13T11:45:14.934 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:14.937 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:14.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:14.950 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-06-13T11:45:15.186 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:15.190 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:15.191 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:15.192 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:15.192 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:15.475 INFO:teuthology.orchestra.run.smithi043.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:45:15.481 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/086 2024-06-13T11:45:15.482 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/086 2024-06-13T11:45:15.482 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:15.485 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:15.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:15.505 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-06-13T11:45:15.745 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:15.750 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:15.750 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:15.752 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:15.752 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:16.143 INFO:teuthology.orchestra.run.smithi043.stdout:generic/087 1s 2024-06-13T11:45:16.151 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/087 2024-06-13T11:45:16.152 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:16.155 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:16.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:16.227 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-06-13T11:45:16.593 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:16.599 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:16.599 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:16.601 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:16.601 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:generic/088 0s 2024-06-13T11:45:16.924 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/088 2024-06-13T11:45:16.924 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:45:16.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:45:16.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:45:16.975 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-06-13T11:45:17.305 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:45:17.311 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:45:17.312 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:45:17.313 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:45:17.313 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:47:26.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:47:26.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:47:59.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:47:59.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:48:29.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:48:29.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:48:59.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:48:59.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:49:29.654 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:49:29.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:49:29.691 INFO:tasks.ceph.mds.d.smithi053.stderr:2024-06-13T11:49:29.691+0000 7fc687bad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44485) UID: 0 2024-06-13T11:49:29.691 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T11:49:29.691+0000 7fe599183640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44485) UID: 0 2024-06-13T11:52:31.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:52:31.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:53:01.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:53:01.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:53:01.383 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T11:53:01.383+0000 7fe599183640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44531) UID: 0 2024-06-13T11:53:01.383 INFO:tasks.ceph.mds.d.smithi053.stderr:2024-06-13T11:53:01.383+0000 7fc687bad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44531) UID: 0 2024-06-13T11:54:02.628 INFO:teuthology.orchestra.run.smithi043.stdout:generic/089 525s 2024-06-13T11:54:02.634 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/089 2024-06-13T11:54:02.634 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:54:02.636 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:54:04.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:54:04.306 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-06-13T11:54:04.611 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:54:04.615 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:54:04.615 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:54:04.617 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:54:04.617 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:54:04.862 INFO:teuthology.orchestra.run.smithi043.stdout:generic/090 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:54:04.867 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/090 2024-06-13T11:54:04.867 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/090 2024-06-13T11:54:04.867 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:54:04.870 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:54:04.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:54:04.883 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-06-13T11:54:05.064 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:54:05.068 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:54:05.068 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:54:05.069 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:54:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:40.557 INFO:teuthology.orchestra.run.smithi043.stdout:generic/091 95s 2024-06-13T11:55:40.563 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/091 2024-06-13T11:55:40.563 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:40.566 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:40.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:40.615 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-06-13T11:55:41.010 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:41.014 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:41.015 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:41.016 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:41.016 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:41.233 INFO:teuthology.orchestra.run.smithi043.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:55:41.238 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/092 2024-06-13T11:55:41.238 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/092 2024-06-13T11:55:41.238 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:41.240 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:41.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:41.254 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-06-13T11:55:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:41.447 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:41.447 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:41.449 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:41.917 INFO:teuthology.orchestra.run.smithi043.stdout:generic/093 0s 2024-06-13T11:55:41.924 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/093 2024-06-13T11:55:41.924 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:41.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:41.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:41.979 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-06-13T11:55:42.384 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:42.387 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:42.388 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:42.389 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:42.389 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:42.652 INFO:teuthology.orchestra.run.smithi043.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-06-13T11:55:42.658 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/094 2024-06-13T11:55:42.658 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/094 2024-06-13T11:55:42.658 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:42.660 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:42.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:42.711 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-06-13T11:55:43.117 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:43.121 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:43.122 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:43.122 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:53.948 INFO:teuthology.orchestra.run.smithi043.stdout:generic/095 10s 2024-06-13T11:55:53.964 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/095 2024-06-13T11:55:53.964 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:53.972 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:53.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:53.989 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-06-13T11:55:54.214 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:54.218 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:54.218 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:54.220 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:54.220 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:54.504 INFO:teuthology.orchestra.run.smithi043.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-06-13T11:55:54.508 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/096 2024-06-13T11:55:54.509 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/096 2024-06-13T11:55:54.509 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:54.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:54.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:54.527 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-06-13T11:55:54.704 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:54.708 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:54.708 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:54.709 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:54.710 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:55.352 INFO:teuthology.orchestra.run.smithi043.stdout:generic/097 1s 2024-06-13T11:55:55.359 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/097 2024-06-13T11:55:55.359 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:55.362 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:55.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:55.377 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-06-13T11:55:55.571 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:55.575 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:55.575 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:55.576 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:55.576 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:56.438 INFO:teuthology.orchestra.run.smithi043.stdout:generic/098 1s 2024-06-13T11:55:56.445 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/098 2024-06-13T11:55:56.445 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:56.447 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:56.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:56.456 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-06-13T11:55:56.643 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:56.647 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:56.648 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:56.649 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:56.649 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:57.405 INFO:teuthology.orchestra.run.smithi043.stdout:generic/099 1s 2024-06-13T11:55:57.411 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/099 2024-06-13T11:55:57.412 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:55:57.414 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:57.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:55:57.469 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-06-13T11:55:57.852 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:55:57.856 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:55:57.856 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:55:57.857 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:55:57.857 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:55:58.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:55:58.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:56:08.713 INFO:teuthology.orchestra.run.smithi043.stdout:generic/100 11s 2024-06-13T11:56:08.719 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/100 2024-06-13T11:56:08.719 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:11.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:11.792 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-06-13T11:56:12.082 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:12.086 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:12.086 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:12.087 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:12.087 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:generic/101 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:56:12.317 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/101 2024-06-13T11:56:12.318 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/101 2024-06-13T11:56:12.318 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:12.320 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:12.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:12.332 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-06-13T11:56:12.527 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:12.531 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:12.531 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:12.532 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:12.532 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:12.744 INFO:teuthology.orchestra.run.smithi043.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T11:56:12.749 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/102 2024-06-13T11:56:12.749 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/102 2024-06-13T11:56:12.750 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:12.752 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:12.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:12.764 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-06-13T11:56:12.945 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:12.949 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:12.949 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:12.950 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:12.951 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:13.192 INFO:teuthology.orchestra.run.smithi043.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T11:56:13.197 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/103 2024-06-13T11:56:13.197 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/103 2024-06-13T11:56:13.197 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:13.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:13.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:13.256 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-06-13T11:56:13.681 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:13.685 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:13.685 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:13.686 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:13.686 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:13.918 INFO:teuthology.orchestra.run.smithi043.stdout:generic/104 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:56:13.923 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/104 2024-06-13T11:56:13.923 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/104 2024-06-13T11:56:13.923 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:13.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:13.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:13.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-06-13T11:56:14.142 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:14.146 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:14.146 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:14.147 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:14.147 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:14.884 INFO:teuthology.orchestra.run.smithi043.stdout:generic/105 0s 2024-06-13T11:56:14.902 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/105 2024-06-13T11:56:14.902 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:14.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:14.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:14.929 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-06-13T11:56:15.246 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:15.250 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:15.250 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:15.251 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:15.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:15.504 INFO:teuthology.orchestra.run.smithi043.stdout:generic/106 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:56:15.509 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/106 2024-06-13T11:56:15.509 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/106 2024-06-13T11:56:15.509 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:15.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:15.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:15.528 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-06-13T11:56:15.725 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:15.729 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:15.729 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:15.730 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:15.730 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:15.971 INFO:teuthology.orchestra.run.smithi043.stdout:generic/107 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:56:15.976 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/107 2024-06-13T11:56:15.976 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/107 2024-06-13T11:56:15.976 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:15.978 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:15.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:15.996 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-06-13T11:56:16.180 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:16.184 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:16.185 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:16.185 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:16.495 INFO:teuthology.orchestra.run.smithi043.stdout:generic/108 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T11:56:16.500 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/108 2024-06-13T11:56:16.500 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/108 2024-06-13T11:56:16.500 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:16.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:16.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:16.515 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-06-13T11:56:16.717 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:16.721 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:16.722 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:16.723 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:16.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:27.772 INFO:teuthology.orchestra.run.smithi043.stdout:generic/109 11s 2024-06-13T11:56:27.787 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/109 2024-06-13T11:56:27.787 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:27.790 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:27.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:27.800 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-06-13T11:56:28.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:56:28.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:56:28.501 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:28.505 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:28.505 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:28.506 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:28.507 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:47.679 INFO:teuthology.orchestra.run.smithi043.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T11:56:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/110 2024-06-13T11:56:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/110 2024-06-13T11:56:47.684 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:47.689 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:47.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:47.758 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-06-13T11:56:48.254 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:48.258 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:48.258 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:48.259 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:48.259 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:48.553 INFO:teuthology.orchestra.run.smithi043.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T11:56:48.558 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/111 2024-06-13T11:56:48.558 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/111 2024-06-13T11:56:48.558 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:56:48.560 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:48.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:56:48.621 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-06-13T11:56:49.006 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:56:49.010 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:56:49.010 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:56:49.011 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:56:49.012 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:56:58.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:56:58.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:57:03.974 INFO:teuthology.orchestra.run.smithi043.stdout:generic/112 14s 2024-06-13T11:57:03.980 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/112 2024-06-13T11:57:03.981 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:03.983 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:04.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:04.033 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-06-13T11:57:04.427 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:04.431 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:04.431 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:04.432 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:04.433 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:19.970 INFO:teuthology.orchestra.run.smithi043.stdout:generic/113 15s 2024-06-13T11:57:19.977 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/113 2024-06-13T11:57:19.977 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:19.979 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:20.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:20.020 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-06-13T11:57:20.568 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:20.572 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:20.573 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:20.574 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:20.574 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:20.806 INFO:teuthology.orchestra.run.smithi043.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-06-13T11:57:20.811 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/114 2024-06-13T11:57:20.811 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/114 2024-06-13T11:57:20.811 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:20.814 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:20.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:20.833 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-06-13T11:57:21.017 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:21.021 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:21.021 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:21.022 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:21.022 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:21.260 INFO:teuthology.orchestra.run.smithi043.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T11:57:21.265 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/115 2024-06-13T11:57:21.265 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/115 2024-06-13T11:57:21.266 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:21.268 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:21.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:21.323 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-06-13T11:57:21.715 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:21.719 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:21.720 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:21.721 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:21.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:21.964 INFO:teuthology.orchestra.run.smithi043.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T11:57:21.969 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/116 2024-06-13T11:57:21.969 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/116 2024-06-13T11:57:21.970 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:21.972 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:22.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:22.014 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-06-13T11:57:22.424 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:22.428 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:22.429 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:22.430 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:22.430 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:28.554 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:57:28.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:57:35.634 INFO:teuthology.orchestra.run.smithi043.stdout:generic/117 13s 2024-06-13T11:57:35.641 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/117 2024-06-13T11:57:35.641 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:35.643 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:35.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:35.652 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-06-13T11:57:35.847 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:35.851 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:35.851 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:35.852 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:35.852 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:36.426 INFO:teuthology.orchestra.run.smithi043.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T11:57:36.431 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/118 2024-06-13T11:57:36.431 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/118 2024-06-13T11:57:36.431 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:36.433 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:36.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:36.489 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-06-13T11:57:36.909 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:36.913 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:36.913 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:36.914 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:36.914 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:37.228 INFO:teuthology.orchestra.run.smithi043.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T11:57:37.233 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/119 2024-06-13T11:57:37.233 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/119 2024-06-13T11:57:37.233 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:37.235 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:37.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:37.291 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-06-13T11:57:37.703 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:37.708 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:37.708 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:37.709 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:37.709 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:37.914 INFO:teuthology.orchestra.run.smithi043.stdout:generic/120 [not run] atime not maintained by ceph 2024-06-13T11:57:37.918 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/120 2024-06-13T11:57:37.919 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/120 2024-06-13T11:57:37.919 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:37.921 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:37.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:37.932 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-06-13T11:57:38.126 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:38.130 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:38.130 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:38.132 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:38.132 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:38.370 INFO:teuthology.orchestra.run.smithi043.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-06-13T11:57:38.375 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/121 2024-06-13T11:57:38.375 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/121 2024-06-13T11:57:38.375 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:38.378 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:38.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:38.449 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-06-13T11:57:38.840 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:38.843 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:38.844 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:38.845 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:38.845 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:39.084 INFO:teuthology.orchestra.run.smithi043.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-06-13T11:57:39.089 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/122 2024-06-13T11:57:39.089 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/122 2024-06-13T11:57:39.089 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:39.091 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:39.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:39.135 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-06-13T11:57:39.551 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:39.555 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:39.555 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:39.556 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:39.556 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:40.046 INFO:teuthology.orchestra.run.smithi043.stdout:generic/123 1s 2024-06-13T11:57:40.053 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/123 2024-06-13T11:57:40.053 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:40.055 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:40.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:40.115 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-06-13T11:57:40.509 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:40.513 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:40.514 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:40.515 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:40.515 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:42.463 INFO:teuthology.orchestra.run.smithi043.stdout:generic/124 2s 2024-06-13T11:57:42.481 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/124 2024-06-13T11:57:42.481 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:57:42.492 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:42.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:57:42.939 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-06-13T11:57:43.425 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:57:43.431 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:57:43.431 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:57:43.432 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:57:43.432 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:57:58.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:57:58.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:58:28.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:58:28.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:58:44.832 INFO:teuthology.orchestra.run.smithi043.stdout:generic/125 61s 2024-06-13T11:58:44.840 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/125 2024-06-13T11:58:44.840 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:58:44.843 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:58:44.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:58:44.891 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-06-13T11:58:45.298 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:58:45.302 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:58:45.303 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:58:45.304 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:58:45.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:58:45.698 INFO:teuthology.orchestra.run.smithi043.stdout:generic/126 0s 2024-06-13T11:58:45.705 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/126 2024-06-13T11:58:45.705 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T11:58:45.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:58:45.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T11:58:45.796 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-06-13T11:58:46.212 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T11:58:46.216 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T11:58:46.217 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T11:58:46.218 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T11:58:46.218 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T11:58:58.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:58:58.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:59:28.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:59:28.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:59:58.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T11:59:58.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:00:28.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:00:29.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:00:59.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:00:59.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:01:29.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:01:29.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:01:59.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:01:59.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:02:29.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:02:29.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:02:59.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:02:59.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:03:30.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:03:30.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:04:00.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:04:00.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:04:30.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:04:30.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:05:00.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:05:00.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:05:30.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:05:30.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:06:00.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:06:00.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:06:31.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:06:31.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:07:01.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:07:01.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:07:31.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:07:31.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:07:52.549 INFO:teuthology.orchestra.run.smithi043.stdout:generic/127 546s 2024-06-13T12:07:52.555 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/127 2024-06-13T12:07:52.555 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:07:52.558 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:52.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:07:52.606 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-06-13T12:07:53.010 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:07:53.014 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:07:53.015 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:07:53.016 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:07:53.016 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:53.972 INFO:teuthology.orchestra.run.smithi043.stdout:generic/128 0s 2024-06-13T12:07:53.979 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/128 2024-06-13T12:07:53.980 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:07:53.982 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:53.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:07:53.992 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-06-13T12:07:54.181 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:07:54.185 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:07:54.185 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:07:54.186 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:07:54.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:54.414 INFO:teuthology.orchestra.run.smithi043.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-06-13T12:07:54.419 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/129 2024-06-13T12:07:54.419 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/129 2024-06-13T12:07:54.419 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:07:54.422 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:54.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:07:54.441 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-06-13T12:07:54.626 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:07:54.630 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:07:54.630 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:07:54.632 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:07:54.632 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:54.851 INFO:teuthology.orchestra.run.smithi043.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-06-13T12:07:54.856 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/130 2024-06-13T12:07:54.856 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/130 2024-06-13T12:07:54.856 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:07:54.858 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:54.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:07:54.879 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-06-13T12:07:55.072 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:07:55.076 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:07:55.076 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:07:55.077 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:07:55.077 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:56.399 INFO:teuthology.orchestra.run.smithi043.stdout:generic/131 1s 2024-06-13T12:07:56.407 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/131 2024-06-13T12:07:56.407 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:07:56.410 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:07:56.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:07:56.470 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-06-13T12:07:56.869 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:07:56.873 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:07:56.874 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:07:56.875 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:07:56.875 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:08:01.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:08:01.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:08:09.089 INFO:teuthology.orchestra.run.smithi043.stdout:generic/132 13s 2024-06-13T12:08:09.095 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/132 2024-06-13T12:08:09.095 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:08:09.098 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:08:09.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:08:09.108 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-06-13T12:08:09.296 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:08:09.300 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:08:09.300 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:08:09.301 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:08:09.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:08:31.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:08:31.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:09:01.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:09:01.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:09:31.922 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:09:31.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:10:01.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:10:01.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:10:32.061 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:10:32.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:11:02.143 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:11:02.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:11:26.744 INFO:teuthology.orchestra.run.smithi043.stdout:generic/133 197s 2024-06-13T12:11:26.750 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/133 2024-06-13T12:11:26.751 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:26.753 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:26.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:26.804 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-06-13T12:11:27.373 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:27.377 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:27.377 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:27.378 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:27.378 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:27.711 INFO:teuthology.orchestra.run.smithi043.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:27.716 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/134 2024-06-13T12:11:27.717 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/134 2024-06-13T12:11:27.717 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:27.719 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:27.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:27.765 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-06-13T12:11:28.182 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:28.186 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:28.186 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:28.187 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:28.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:28.983 INFO:teuthology.orchestra.run.smithi043.stdout:generic/135 0s 2024-06-13T12:11:28.985 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/135 2024-06-13T12:11:28.985 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:28.987 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:28.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:28.997 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-06-13T12:11:29.180 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:29.187 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:29.188 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:29.188 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:29.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:29.437 INFO:teuthology.orchestra.run.smithi043.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-06-13T12:11:29.442 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/136 2024-06-13T12:11:29.442 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/136 2024-06-13T12:11:29.442 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:29.444 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:29.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:29.494 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-06-13T12:11:29.917 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:29.921 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:29.922 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:29.922 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:29.923 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:30.170 INFO:teuthology.orchestra.run.smithi043.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:30.175 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/137 2024-06-13T12:11:30.175 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/137 2024-06-13T12:11:30.175 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:30.178 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:30.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:30.237 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-06-13T12:11:30.633 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:30.637 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:30.637 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:30.638 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:30.638 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:30.880 INFO:teuthology.orchestra.run.smithi043.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:30.885 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/138 2024-06-13T12:11:30.886 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/138 2024-06-13T12:11:30.886 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:30.888 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:30.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:30.945 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-06-13T12:11:31.338 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:31.342 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:31.342 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:31.343 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:31.343 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:31.591 INFO:teuthology.orchestra.run.smithi043.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:31.594 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/139 2024-06-13T12:11:31.594 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/139 2024-06-13T12:11:31.594 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:31.596 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:31.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:31.668 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-06-13T12:11:32.057 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:32.062 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:32.062 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:32.064 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:32.064 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:32.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:11:32.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:11:32.303 INFO:teuthology.orchestra.run.smithi043.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:32.308 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/140 2024-06-13T12:11:32.309 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/140 2024-06-13T12:11:32.309 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:32.311 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:32.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:32.365 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-06-13T12:11:32.783 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:32.786 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:32.787 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:32.787 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:33.121 INFO:teuthology.orchestra.run.smithi043.stdout:generic/141 1s 2024-06-13T12:11:33.127 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/141 2024-06-13T12:11:33.127 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:33.130 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:33.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:33.140 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-06-13T12:11:33.321 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:33.326 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:33.327 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:33.327 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:33.327 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:33.567 INFO:teuthology.orchestra.run.smithi043.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:33.572 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/142 2024-06-13T12:11:33.572 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/142 2024-06-13T12:11:33.572 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:33.575 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:33.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:33.630 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-06-13T12:11:34.031 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:34.034 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:34.035 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:34.036 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:34.036 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:34.283 INFO:teuthology.orchestra.run.smithi043.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:34.288 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/143 2024-06-13T12:11:34.289 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/143 2024-06-13T12:11:34.289 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:34.291 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:34.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:34.341 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-06-13T12:11:34.739 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:34.743 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:34.744 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:34.745 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:34.745 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:34.987 INFO:teuthology.orchestra.run.smithi043.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:34.992 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/144 2024-06-13T12:11:34.992 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/144 2024-06-13T12:11:34.992 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:34.995 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:35.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:35.048 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-06-13T12:11:35.448 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:35.452 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:35.452 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:35.453 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:35.453 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:35.709 INFO:teuthology.orchestra.run.smithi043.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:35.714 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/145 2024-06-13T12:11:35.714 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/145 2024-06-13T12:11:35.714 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:35.716 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:35.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:35.778 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-06-13T12:11:36.174 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:36.178 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:36.178 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:36.179 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:36.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:36.429 INFO:teuthology.orchestra.run.smithi043.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:36.434 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/146 2024-06-13T12:11:36.434 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/146 2024-06-13T12:11:36.434 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:36.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:36.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:36.494 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-06-13T12:11:36.889 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:36.893 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:36.893 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:36.894 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:36.894 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:37.149 INFO:teuthology.orchestra.run.smithi043.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:37.154 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/147 2024-06-13T12:11:37.155 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/147 2024-06-13T12:11:37.155 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:37.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:37.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:37.209 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-06-13T12:11:37.620 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:37.624 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:37.624 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:37.625 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:37.625 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:37.864 INFO:teuthology.orchestra.run.smithi043.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:37.869 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/148 2024-06-13T12:11:37.869 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/148 2024-06-13T12:11:37.869 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:37.871 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:37.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:37.925 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-06-13T12:11:38.326 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:38.330 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:38.330 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:38.331 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:38.331 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:38.573 INFO:teuthology.orchestra.run.smithi043.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:38.579 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/149 2024-06-13T12:11:38.579 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/149 2024-06-13T12:11:38.579 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:38.581 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:38.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:38.639 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-06-13T12:11:39.038 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:39.042 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:39.042 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:39.043 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:39.287 INFO:teuthology.orchestra.run.smithi043.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/150 2024-06-13T12:11:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/150 2024-06-13T12:11:39.292 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:39.295 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:39.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:39.343 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-06-13T12:11:39.759 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:39.763 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:39.763 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:39.764 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:39.764 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:40.000 INFO:teuthology.orchestra.run.smithi043.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:40.005 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/151 2024-06-13T12:11:40.005 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/151 2024-06-13T12:11:40.005 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:40.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:40.062 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-06-13T12:11:40.469 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:40.474 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:40.474 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:40.709 INFO:teuthology.orchestra.run.smithi043.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:40.714 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/152 2024-06-13T12:11:40.715 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/152 2024-06-13T12:11:40.715 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:40.717 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:40.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:40.779 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-06-13T12:11:41.185 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:41.189 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:41.190 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:41.191 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:41.191 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:41.426 INFO:teuthology.orchestra.run.smithi043.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:41.431 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/153 2024-06-13T12:11:41.431 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/153 2024-06-13T12:11:41.431 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:41.434 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:41.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:41.491 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-06-13T12:11:41.888 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:41.892 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:41.893 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:41.894 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:41.894 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:42.133 INFO:teuthology.orchestra.run.smithi043.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:42.138 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/154 2024-06-13T12:11:42.138 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/154 2024-06-13T12:11:42.138 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:42.141 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:42.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:42.202 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-06-13T12:11:42.607 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:42.610 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:42.611 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:42.612 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:42.612 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:42.853 INFO:teuthology.orchestra.run.smithi043.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:42.858 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/155 2024-06-13T12:11:42.858 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/155 2024-06-13T12:11:42.858 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:42.860 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:42.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:42.917 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-06-13T12:11:43.324 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:43.328 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:43.328 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:43.329 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:43.329 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:43.575 INFO:teuthology.orchestra.run.smithi043.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:43.579 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/156 2024-06-13T12:11:43.580 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/156 2024-06-13T12:11:43.580 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:43.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:43.630 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-06-13T12:11:44.045 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:44.049 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:44.049 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:44.050 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:44.050 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:11:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/157 2024-06-13T12:11:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/157 2024-06-13T12:11:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:44.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:44.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:44.364 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-06-13T12:11:44.774 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:44.778 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:44.778 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:44.779 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:44.779 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:45.028 INFO:teuthology.orchestra.run.smithi043.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-06-13T12:11:45.033 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/158 2024-06-13T12:11:45.033 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/158 2024-06-13T12:11:45.033 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:45.035 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:45.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:45.106 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-06-13T12:11:45.512 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:45.516 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:45.517 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:45.518 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:45.518 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:45.757 INFO:teuthology.orchestra.run.smithi043.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-06-13T12:11:45.762 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/159 2024-06-13T12:11:45.763 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/159 2024-06-13T12:11:45.763 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:45.765 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:45.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:45.794 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-06-13T12:11:45.979 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:45.983 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:45.983 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:45.984 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:45.984 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:46.214 INFO:teuthology.orchestra.run.smithi043.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-06-13T12:11:46.219 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/160 2024-06-13T12:11:46.219 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/160 2024-06-13T12:11:46.219 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:46.221 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:46.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:46.239 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-06-13T12:11:46.420 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:46.424 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:46.424 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:46.425 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:46.425 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:46.788 INFO:teuthology.orchestra.run.smithi043.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:46.798 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/161 2024-06-13T12:11:46.798 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/161 2024-06-13T12:11:46.798 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:46.815 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:46.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:46.959 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-06-13T12:11:47.213 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:47.217 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:47.217 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:47.218 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:47.218 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:47.553 INFO:teuthology.orchestra.run.smithi043.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-06-13T12:11:47.600 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/162 2024-06-13T12:11:47.600 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/162 2024-06-13T12:11:47.600 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:47.605 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:47.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:47.766 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-06-13T12:11:48.042 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:48.046 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:48.046 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:48.047 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:48.047 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:48.369 INFO:teuthology.orchestra.run.smithi043.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-06-13T12:11:48.421 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/163 2024-06-13T12:11:48.421 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/163 2024-06-13T12:11:48.421 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:48.424 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:48.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:48.644 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-06-13T12:11:48.884 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:48.888 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:48.888 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:48.889 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:48.889 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:49.261 INFO:teuthology.orchestra.run.smithi043.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:49.269 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/164 2024-06-13T12:11:49.269 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/164 2024-06-13T12:11:49.270 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:49.274 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:49.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:49.449 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-06-13T12:11:49.692 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:49.696 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:49.696 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:49.697 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:49.697 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:50.064 INFO:teuthology.orchestra.run.smithi043.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:50.076 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/165 2024-06-13T12:11:50.076 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/165 2024-06-13T12:11:50.076 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:50.086 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:50.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:50.209 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-06-13T12:11:50.504 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:50.508 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:50.508 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:50.509 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:50.509 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:50.892 INFO:teuthology.orchestra.run.smithi043.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:50.904 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/166 2024-06-13T12:11:50.904 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/166 2024-06-13T12:11:50.904 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:50.910 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:51.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:51.119 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-06-13T12:11:51.349 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:51.353 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:51.354 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:51.355 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:51.355 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:51.730 INFO:teuthology.orchestra.run.smithi043.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:51.743 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/167 2024-06-13T12:11:51.743 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/167 2024-06-13T12:11:51.743 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:51.749 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:51.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:51.944 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-06-13T12:11:52.159 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:52.163 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:52.163 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:52.164 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:52.164 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:52.541 INFO:teuthology.orchestra.run.smithi043.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:52.550 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/168 2024-06-13T12:11:52.550 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/168 2024-06-13T12:11:52.551 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:52.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:52.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:52.769 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-06-13T12:11:52.985 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:52.989 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:52.989 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:52.990 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:52.990 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:53.410 INFO:teuthology.orchestra.run.smithi043.stdout:generic/169 0s 2024-06-13T12:11:53.416 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/169 2024-06-13T12:11:53.416 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:53.418 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:53.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:53.427 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-06-13T12:11:53.625 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:53.629 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:53.629 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:53.630 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:53.630 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:53.980 INFO:teuthology.orchestra.run.smithi043.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:53.988 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/170 2024-06-13T12:11:53.988 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/170 2024-06-13T12:11:53.988 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:53.994 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:54.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:54.244 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-06-13T12:11:54.448 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:54.452 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:54.452 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:54.453 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:54.453 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:54.820 INFO:teuthology.orchestra.run.smithi043.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/171 2024-06-13T12:11:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/171 2024-06-13T12:11:54.828 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:54.831 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:55.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:55.048 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-06-13T12:11:55.270 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:55.273 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:55.273 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:55.274 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:55.274 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:55.656 INFO:teuthology.orchestra.run.smithi043.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:55.669 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/172 2024-06-13T12:11:55.669 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/172 2024-06-13T12:11:55.669 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:55.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:55.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:55.841 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-06-13T12:11:56.094 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:56.098 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:56.098 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:56.099 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:56.099 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:56.468 INFO:teuthology.orchestra.run.smithi043.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:56.479 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/173 2024-06-13T12:11:56.479 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/173 2024-06-13T12:11:56.479 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:56.491 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:56.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:56.682 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-06-13T12:11:56.918 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:56.923 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:56.923 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:56.924 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:56.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:57.283 INFO:teuthology.orchestra.run.smithi043.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:57.295 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/174 2024-06-13T12:11:57.295 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/174 2024-06-13T12:11:57.295 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:57.299 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:57.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:57.506 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-06-13T12:11:57.736 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:57.740 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:57.740 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:57.741 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:57.741 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:58.113 INFO:teuthology.orchestra.run.smithi043.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:58.131 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/175 2024-06-13T12:11:58.131 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/175 2024-06-13T12:11:58.131 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:58.143 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:58.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:58.314 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-06-13T12:11:58.554 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:58.558 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:58.558 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:58.559 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:58.559 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:58.909 INFO:teuthology.orchestra.run.smithi043.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:11:58.922 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/176 2024-06-13T12:11:58.922 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/176 2024-06-13T12:11:58.922 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:58.924 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:59.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:59.107 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-06-13T12:11:59.363 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:11:59.367 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:11:59.367 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:11:59.368 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:11:59.368 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:59.701 INFO:teuthology.orchestra.run.smithi043.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-06-13T12:11:59.707 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/177 2024-06-13T12:11:59.707 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/177 2024-06-13T12:11:59.707 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:11:59.709 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:11:59.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:11:59.760 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-06-13T12:12:00.172 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:00.176 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:00.176 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:00.177 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:00.177 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:00.435 INFO:teuthology.orchestra.run.smithi043.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:12:00.441 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/178 2024-06-13T12:12:00.441 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/178 2024-06-13T12:12:00.441 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:00.443 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:00.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:00.504 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-06-13T12:12:00.907 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:00.911 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:00.911 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:00.912 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:00.912 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:01.158 INFO:teuthology.orchestra.run.smithi043.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:12:01.163 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/179 2024-06-13T12:12:01.163 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/179 2024-06-13T12:12:01.164 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:01.166 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:01.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:01.227 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-06-13T12:12:01.637 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:01.641 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:01.641 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:01.642 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:01.642 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:01.880 INFO:teuthology.orchestra.run.smithi043.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:12:01.885 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/180 2024-06-13T12:12:01.885 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/180 2024-06-13T12:12:01.885 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:01.887 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:01.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:01.955 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-06-13T12:12:02.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:12:02.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:12:02.353 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:02.357 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:02.357 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:02.358 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:02.358 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:02.612 INFO:teuthology.orchestra.run.smithi043.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:12:02.617 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/181 2024-06-13T12:12:02.617 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/181 2024-06-13T12:12:02.617 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:02.619 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:02.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:02.679 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-06-13T12:12:03.107 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:03.111 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:03.112 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:03.113 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:03.354 INFO:teuthology.orchestra.run.smithi043.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-06-13T12:12:03.359 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/182 2024-06-13T12:12:03.359 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/182 2024-06-13T12:12:03.359 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:03.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:03.429 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-06-13T12:12:03.829 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:03.833 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:03.833 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:03.835 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:04.184 INFO:teuthology.orchestra.run.smithi043.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:04.192 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/183 2024-06-13T12:12:04.192 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/183 2024-06-13T12:12:04.192 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:04.195 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:04.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:04.372 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-06-13T12:12:04.628 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:04.632 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:04.632 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:04.633 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:04.633 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:04.884 INFO:teuthology.orchestra.run.smithi043.stdout:generic/184 0s 2024-06-13T12:12:04.890 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/184 2024-06-13T12:12:04.890 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:04.893 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:04.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:04.909 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-06-13T12:12:05.098 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:05.102 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:05.102 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:05.103 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:05.103 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:05.460 INFO:teuthology.orchestra.run.smithi043.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:05.470 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/185 2024-06-13T12:12:05.470 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/185 2024-06-13T12:12:05.470 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:05.474 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:05.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:05.623 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-06-13T12:12:05.899 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:05.903 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:05.903 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:05.905 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:06.261 INFO:teuthology.orchestra.run.smithi043.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:06.273 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/186 2024-06-13T12:12:06.273 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/186 2024-06-13T12:12:06.273 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:06.283 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:06.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:06.474 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-06-13T12:12:06.706 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:06.709 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:06.710 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:06.711 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:06.711 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:07.085 INFO:teuthology.orchestra.run.smithi043.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:07.095 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/187 2024-06-13T12:12:07.095 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/187 2024-06-13T12:12:07.095 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:07.101 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:07.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:07.302 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-06-13T12:12:07.531 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:07.535 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:07.535 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:07.536 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:07.536 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:07.894 INFO:teuthology.orchestra.run.smithi043.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:07.910 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/188 2024-06-13T12:12:07.910 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/188 2024-06-13T12:12:07.910 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:07.919 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:08.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:08.075 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-06-13T12:12:08.330 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:08.334 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:08.334 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:08.335 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:08.335 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:08.694 INFO:teuthology.orchestra.run.smithi043.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:08.707 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/189 2024-06-13T12:12:08.707 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/189 2024-06-13T12:12:08.707 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:08.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:08.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:08.932 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-06-13T12:12:09.159 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:09.163 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:09.163 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:09.165 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:09.165 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:09.528 INFO:teuthology.orchestra.run.smithi043.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:09.539 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/190 2024-06-13T12:12:09.539 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/190 2024-06-13T12:12:09.539 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:09.543 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:09.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:09.760 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-06-13T12:12:09.977 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:09.981 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:09.981 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:09.982 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:09.982 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:10.322 INFO:teuthology.orchestra.run.smithi043.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:10.333 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/191 2024-06-13T12:12:10.334 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/191 2024-06-13T12:12:10.334 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:10.338 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:10.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:10.513 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-06-13T12:12:10.786 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:10.790 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:10.791 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:10.792 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:10.792 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:11.012 INFO:teuthology.orchestra.run.smithi043.stdout:generic/192 [not run] atime not maintained by ceph 2024-06-13T12:12:11.017 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/192 2024-06-13T12:12:11.017 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/192 2024-06-13T12:12:11.017 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:11.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:11.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:11.032 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-06-13T12:12:11.216 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:11.220 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:11.220 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:11.222 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:11.222 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:12.232 INFO:teuthology.orchestra.run.smithi043.stdout:generic/193 1s 2024-06-13T12:12:12.238 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/193 2024-06-13T12:12:12.238 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:12.240 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:12.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:12.310 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-06-13T12:12:12.716 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:12.720 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:12.720 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:12.721 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:12.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:13.089 INFO:teuthology.orchestra.run.smithi043.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:13.101 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/194 2024-06-13T12:12:13.101 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/194 2024-06-13T12:12:13.101 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:13.103 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:13.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:13.241 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-06-13T12:12:13.526 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:13.530 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:13.530 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:13.531 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:13.531 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:13.905 INFO:teuthology.orchestra.run.smithi043.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:13.912 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/195 2024-06-13T12:12:13.912 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/195 2024-06-13T12:12:13.912 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:13.917 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:14.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:14.128 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-06-13T12:12:14.361 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:14.365 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:14.366 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:14.366 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:14.367 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:14.749 INFO:teuthology.orchestra.run.smithi043.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:14.754 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/196 2024-06-13T12:12:14.754 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/196 2024-06-13T12:12:14.755 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:14.758 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:14.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:14.980 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-06-13T12:12:15.199 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:15.203 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:15.204 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:15.205 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:15.205 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:15.571 INFO:teuthology.orchestra.run.smithi043.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:15.579 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/197 2024-06-13T12:12:15.579 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/197 2024-06-13T12:12:15.579 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:15.587 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:15.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:15.824 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-06-13T12:12:16.037 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:16.041 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:16.041 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:16.043 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:16.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:16.635 INFO:teuthology.orchestra.run.smithi043.stdout:generic/198 0s 2024-06-13T12:12:16.642 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/198 2024-06-13T12:12:16.642 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:16.644 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:16.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:16.703 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-06-13T12:12:17.111 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:17.115 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:17.115 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:17.116 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:17.116 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:17.462 INFO:teuthology.orchestra.run.smithi043.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:17.469 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/199 2024-06-13T12:12:17.470 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/199 2024-06-13T12:12:17.470 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:17.474 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:17.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:17.702 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-06-13T12:12:17.958 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:17.962 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:17.962 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:17.963 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:17.964 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:18.320 INFO:teuthology.orchestra.run.smithi043.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:18.328 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/200 2024-06-13T12:12:18.328 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/200 2024-06-13T12:12:18.328 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:18.332 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:18.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:18.570 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-06-13T12:12:18.778 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:18.782 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:18.782 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:18.783 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:18.783 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:19.139 INFO:teuthology.orchestra.run.smithi043.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:19.152 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/201 2024-06-13T12:12:19.152 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/201 2024-06-13T12:12:19.152 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:19.154 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:19.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:19.337 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-06-13T12:12:19.581 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:19.585 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:19.586 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:19.587 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:19.587 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:19.930 INFO:teuthology.orchestra.run.smithi043.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:19.941 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/202 2024-06-13T12:12:19.941 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/202 2024-06-13T12:12:19.941 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:19.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:20.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:20.202 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-06-13T12:12:20.421 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:20.425 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:20.425 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:20.426 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:20.813 INFO:teuthology.orchestra.run.smithi043.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:20.822 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/203 2024-06-13T12:12:20.823 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/203 2024-06-13T12:12:20.823 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:20.831 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:21.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:21.015 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-06-13T12:12:21.268 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:21.272 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:21.272 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:21.273 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:21.274 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:24.251 INFO:teuthology.orchestra.run.smithi043.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:12:24.257 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/204 2024-06-13T12:12:24.257 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/204 2024-06-13T12:12:24.257 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:24.260 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:24.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:24.275 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-06-13T12:12:24.465 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:24.468 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:24.468 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:24.469 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:24.469 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:24.826 INFO:teuthology.orchestra.run.smithi043.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:24.835 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/205 2024-06-13T12:12:24.835 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/205 2024-06-13T12:12:24.835 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:24.845 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:25.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:25.076 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-06-13T12:12:25.287 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:25.291 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:25.292 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:25.293 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:25.293 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:25.656 INFO:teuthology.orchestra.run.smithi043.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:12:25.663 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/206 2024-06-13T12:12:25.663 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/206 2024-06-13T12:12:25.664 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:25.667 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:25.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:25.898 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-06-13T12:12:26.114 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:26.118 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:26.118 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:26.119 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:26.120 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:32.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:12:32.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:12:33.013 INFO:teuthology.orchestra.run.smithi043.stdout:generic/207 7s 2024-06-13T12:12:33.020 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/207 2024-06-13T12:12:33.020 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:12:33.022 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:12:33.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:12:33.084 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-06-13T12:12:33.520 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:12:33.524 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:12:33.525 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:12:33.526 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:12:33.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:13:02.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:13:02.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:13:02.476 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T12:13:02.476+0000 7ff89b921640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45949) UID: 0 2024-06-13T12:13:02.476 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T12:13:02.476+0000 7f4aa3f08640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45949) UID: 0 2024-06-13T12:13:02.476 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T12:13:02.476+0000 7f8ff812c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45949) UID: 0 2024-06-13T12:13:02.479 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T12:13:02.479+0000 7f03d9b69640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45949) UID: 0 2024-06-13T12:15:48.173 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T12:15:48.172+0000 7f03d0173640 -1 bdev(0x560704e3ce00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-06-13T12:15:48.174 INFO:tasks.ceph.osd.5.smithi053.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f03d0173640 time 2024-06-13T12:15:48.173681+0000 2024-06-13T12:15:48.174 INFO:tasks.ceph.osd.5.smithi053.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-06-13T12:15:48.174 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.174 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5607015ca176] 2024-06-13T12:15:48.174 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.174 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T12:15:48.173+0000 7f03d0173640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f03d0173640 time 2024-06-13T12:15:48.173681+0000 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5607015ca176] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr:*** Caught signal (Aborted) ** 2024-06-13T12:15:48.175 INFO:tasks.ceph.osd.5.smithi053.stderr: in thread 7f03d0173640 thread_name:bstore_aio 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03dd03e6f0] 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f03dd08b94c] 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: raise() 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: abort() 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5607015ca237] 2024-06-13T12:15:48.176 INFO:tasks.ceph.osd.5.smithi053.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 7: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 8: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 9: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr:2024-06-13T12:15:48.175+0000 7f03d0173640 -1 *** Caught signal (Aborted) ** 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: in thread 7f03d0173640 thread_name:bstore_aio 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03dd03e6f0] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f03dd08b94c] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: raise() 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: abort() 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5607015ca237] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 7: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.177 INFO:tasks.ceph.osd.5.smithi053.stderr: 8: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.178 INFO:tasks.ceph.osd.5.smithi053.stderr: 9: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.178 INFO:tasks.ceph.osd.5.smithi053.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-13T12:15:48.178 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.187 INFO:tasks.ceph.osd.5.smithi053.stderr: -137> 2024-06-13T12:15:48.172+0000 7f03d0173640 -1 bdev(0x560704e3ce00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-06-13T12:15:48.187 INFO:tasks.ceph.osd.5.smithi053.stderr: -112> 2024-06-13T12:15:48.173+0000 7f03d0173640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f03d0173640 time 2024-06-13T12:15:48.173681+0000 2024-06-13T12:15:48.187 INFO:tasks.ceph.osd.5.smithi053.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5607015ca176] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 0> 2024-06-13T12:15:48.175+0000 7f03d0173640 -1 *** Caught signal (Aborted) ** 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: in thread 7f03d0173640 thread_name:bstore_aio 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03dd03e6f0] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f03dd08b94c] 2024-06-13T12:15:48.188 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: raise() 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: abort() 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5607015ca237] 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 7: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 8: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 9: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-13T12:15:48.189 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.196 INFO:tasks.ceph.osd.5.smithi053.stderr: -357> 2024-06-13T12:15:48.172+0000 7f03d0173640 -1 bdev(0x560704e3ce00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-06-13T12:15:48.196 INFO:tasks.ceph.osd.5.smithi053.stderr: -332> 2024-06-13T12:15:48.173+0000 7f03d0173640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f03d0173640 time 2024-06-13T12:15:48.173681+0000 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2946-g3d89accf/rpm/el9/BUILD/ceph-19.0.0-2946-g3d89accf/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5607015ca176] 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: -220> 2024-06-13T12:15:48.175+0000 7f03d0173640 -1 *** Caught signal (Aborted) ** 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: in thread 7f03d0173640 thread_name:bstore_aio 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.197 INFO:tasks.ceph.osd.5.smithi053.stderr: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03dd03e6f0] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7f03dd08b94c] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 3: raise() 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 4: abort() 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5607015ca237] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x560701f928e0] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 7: ceph-osd(+0xdb8a51) [0x560701f92a51] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 8: /lib64/libc.so.6(+0x89c02) [0x7f03dd089c02] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 9: /lib64/libc.so.6(+0x10ec40) [0x7f03dd10ec40] 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-06-13T12:15:48.198 INFO:tasks.ceph.osd.5.smithi053.stderr: 2024-06-13T12:15:48.276 INFO:tasks.ceph.osd.5.smithi053.stderr:daemon-helper: command failed with exit status 5 2024-06-13T12:15:53.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-06-13T12:15:53.904 INFO:teuthology.orchestra.run.smithi043.stdout:generic/208 200s 2024-06-13T12:15:53.910 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/208 2024-06-13T12:15:53.910 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:15:53.913 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:15:53.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:15:53.957 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-06-13T12:15:54.415 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:15:54.418 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:15:54.419 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:15:54.420 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:15:54.420 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:15:59.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2024-06-13T12:16:06.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2024-06-13T12:16:12.924 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-06-13T12:16:19.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2024-06-13T12:16:26.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2024-06-13T12:16:29.138 INFO:teuthology.orchestra.run.smithi043.stdout:generic/209 35s 2024-06-13T12:16:29.145 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/209 2024-06-13T12:16:29.145 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:29.148 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:29.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:29.193 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-06-13T12:16:29.605 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:29.609 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:29.609 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:29.610 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:29.611 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:29.920 INFO:teuthology.orchestra.run.smithi043.stdout:generic/210 0s 2024-06-13T12:16:29.926 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/210 2024-06-13T12:16:29.926 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:29.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:29.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:29.986 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-06-13T12:16:30.401 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:30.402 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:30.402 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:30.403 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:30.403 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:30.839 INFO:teuthology.orchestra.run.smithi043.stdout:generic/211 0s 2024-06-13T12:16:30.845 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/211 2024-06-13T12:16:30.845 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:30.848 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:30.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:30.860 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-06-13T12:16:31.056 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:31.060 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:31.060 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:31.061 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:31.061 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:31.351 INFO:teuthology.orchestra.run.smithi043.stdout:generic/212 0s 2024-06-13T12:16:31.358 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/212 2024-06-13T12:16:31.358 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:31.360 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:31.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:31.373 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-06-13T12:16:31.576 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:31.580 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:31.580 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:31.581 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:31.581 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:31.805 INFO:teuthology.orchestra.run.smithi043.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:16:31.810 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/213 2024-06-13T12:16:31.810 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/213 2024-06-13T12:16:31.810 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:31.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:31.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:31.824 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-06-13T12:16:32.016 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:32.020 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:32.020 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:32.021 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:32.022 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:32.255 INFO:teuthology.orchestra.run.smithi043.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:16:32.260 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/214 2024-06-13T12:16:32.260 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/214 2024-06-13T12:16:32.260 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:32.262 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:32.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:32.274 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-06-13T12:16:32.466 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:32.470 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:32.471 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:32.472 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:32.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:32.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-06-13T12:16:34.766 INFO:teuthology.orchestra.run.smithi043.stdout:generic/215 2s 2024-06-13T12:16:34.773 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/215 2024-06-13T12:16:34.773 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:34.776 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:34.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:34.800 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-06-13T12:16:34.991 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:34.995 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:34.995 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:34.997 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:34.997 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:35.366 INFO:teuthology.orchestra.run.smithi043.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:35.375 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/216 2024-06-13T12:16:35.375 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/216 2024-06-13T12:16:35.375 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:35.379 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:35.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:35.581 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-06-13T12:16:35.811 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:35.815 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:35.815 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:35.816 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:35.816 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:36.161 INFO:teuthology.orchestra.run.smithi043.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:36.169 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/217 2024-06-13T12:16:36.170 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/217 2024-06-13T12:16:36.170 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:36.177 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:36.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:36.268 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-06-13T12:16:36.598 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:36.602 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:36.602 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:36.603 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:36.603 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:36.963 INFO:teuthology.orchestra.run.smithi043.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:36.976 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/218 2024-06-13T12:16:36.977 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/218 2024-06-13T12:16:36.977 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:36.983 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:37.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:37.211 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-06-13T12:16:37.436 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:37.441 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:37.441 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:37.442 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:37.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:37.666 INFO:teuthology.orchestra.run.smithi043.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:37.671 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/219 2024-06-13T12:16:37.672 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/219 2024-06-13T12:16:37.672 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:37.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:37.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:37.694 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-06-13T12:16:37.887 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:37.891 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:37.891 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:37.892 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:37.893 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:38.232 INFO:teuthology.orchestra.run.smithi043.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:38.240 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/220 2024-06-13T12:16:38.240 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/220 2024-06-13T12:16:38.240 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:38.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:38.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:38.402 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-06-13T12:16:38.682 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:38.686 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:38.687 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:38.688 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:39.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2024-06-13T12:16:39.975 INFO:teuthology.orchestra.run.smithi043.stdout:generic/221 1s 2024-06-13T12:16:40.067 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/221 2024-06-13T12:16:40.067 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:40.070 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:40.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:40.088 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-06-13T12:16:40.284 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:40.288 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:40.288 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:40.289 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:40.289 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:40.656 INFO:teuthology.orchestra.run.smithi043.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:40.674 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/222 2024-06-13T12:16:40.674 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/222 2024-06-13T12:16:40.674 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:40.680 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:40.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:40.929 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-06-13T12:16:41.137 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:41.141 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:41.142 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:41.142 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:41.142 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:41.366 INFO:teuthology.orchestra.run.smithi043.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:16:41.372 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/223 2024-06-13T12:16:41.372 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/223 2024-06-13T12:16:41.372 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:41.374 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:41.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:41.387 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-06-13T12:16:41.577 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:41.581 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:41.581 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:41.582 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:41.582 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:41.804 INFO:teuthology.orchestra.run.smithi043.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:16:41.809 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/224 2024-06-13T12:16:41.809 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/224 2024-06-13T12:16:41.809 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:41.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:41.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:41.823 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-06-13T12:16:42.016 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:42.020 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:42.020 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:42.021 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:42.021 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:42.282 INFO:teuthology.orchestra.run.smithi043.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-06-13T12:16:42.287 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/225 2024-06-13T12:16:42.287 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/225 2024-06-13T12:16:42.288 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:42.290 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:42.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:42.344 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-06-13T12:16:42.764 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:42.768 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:42.768 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:42.769 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:42.769 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:43.009 INFO:teuthology.orchestra.run.smithi043.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:16:43.014 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/226 2024-06-13T12:16:43.014 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/226 2024-06-13T12:16:43.014 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:43.016 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:43.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:43.030 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-06-13T12:16:43.222 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:43.225 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:43.226 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:43.227 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:43.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:43.581 INFO:teuthology.orchestra.run.smithi043.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:43.590 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/227 2024-06-13T12:16:43.591 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/227 2024-06-13T12:16:43.595 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:43.599 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:43.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:43.664 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-06-13T12:16:44.005 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:44.009 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:44.009 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:44.010 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:44.011 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:16:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/228 2024-06-13T12:16:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/228 2024-06-13T12:16:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:44.272 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:44.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:44.284 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-06-13T12:16:44.474 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:44.478 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:44.478 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:44.479 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:44.479 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:44.839 INFO:teuthology.orchestra.run.smithi043.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:44.848 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/229 2024-06-13T12:16:44.849 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/229 2024-06-13T12:16:44.849 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:44.858 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:45.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:45.032 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-06-13T12:16:45.286 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:45.290 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:45.290 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:45.292 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:45.292 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:45.513 INFO:teuthology.orchestra.run.smithi043.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:45.518 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/230 2024-06-13T12:16:45.518 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/230 2024-06-13T12:16:45.518 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:45.521 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:45.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:45.534 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-06-13T12:16:45.721 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:45.725 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:45.725 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:45.726 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:45.938 INFO:teuthology.orchestra.run.smithi043.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:45.943 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/231 2024-06-13T12:16:45.943 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/231 2024-06-13T12:16:45.943 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:45.946 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:45.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:45.969 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-06-13T12:16:45.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2024-06-13T12:16:46.157 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:46.161 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:46.161 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:46.162 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:46.162 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:46.373 INFO:teuthology.orchestra.run.smithi043.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:46.378 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/232 2024-06-13T12:16:46.378 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/232 2024-06-13T12:16:46.378 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:46.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:46.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:46.391 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-06-13T12:16:46.579 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:46.583 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:46.583 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:46.585 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:46.585 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:46.795 INFO:teuthology.orchestra.run.smithi043.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:46.800 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/233 2024-06-13T12:16:46.800 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/233 2024-06-13T12:16:46.800 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:46.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:46.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:46.831 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-06-13T12:16:47.017 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:47.021 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:47.022 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:47.022 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:47.023 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:47.232 INFO:teuthology.orchestra.run.smithi043.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:47.238 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/234 2024-06-13T12:16:47.238 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/234 2024-06-13T12:16:47.238 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:47.240 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:47.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:47.252 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-06-13T12:16:47.444 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:47.448 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:47.448 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:47.449 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:47.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:47.667 INFO:teuthology.orchestra.run.smithi043.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:16:47.673 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/235 2024-06-13T12:16:47.673 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/235 2024-06-13T12:16:47.673 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:47.675 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:47.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:47.687 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-06-13T12:16:47.880 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:47.884 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:47.884 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:47.885 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:47.886 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:49.175 INFO:teuthology.orchestra.run.smithi043.stdout:generic/236 2s 2024-06-13T12:16:49.183 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/236 2024-06-13T12:16:49.183 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:49.185 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:49.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:49.233 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-06-13T12:16:49.656 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:49.660 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:49.660 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:49.661 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:49.661 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:49.945 INFO:teuthology.orchestra.run.smithi043.stdout:generic/237 0s 2024-06-13T12:16:49.951 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/237 2024-06-13T12:16:49.952 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:49.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:49.997 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-06-13T12:16:50.430 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:50.434 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:50.435 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:50.436 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:50.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:50.778 INFO:teuthology.orchestra.run.smithi043.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:16:50.790 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/238 2024-06-13T12:16:50.790 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/238 2024-06-13T12:16:50.790 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:50.792 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:51.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:51.038 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-06-13T12:16:51.255 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:51.259 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:51.259 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:51.260 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:51.261 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:51.492 INFO:teuthology.orchestra.run.smithi043.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-06-13T12:16:51.497 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/239 2024-06-13T12:16:51.497 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/239 2024-06-13T12:16:51.497 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:51.499 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:51.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:51.518 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-06-13T12:16:51.708 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:51.712 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:51.712 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:51.713 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:51.713 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:51.942 INFO:teuthology.orchestra.run.smithi043.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-06-13T12:16:51.947 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/240 2024-06-13T12:16:51.947 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/240 2024-06-13T12:16:51.947 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:16:51.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:51.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:16:51.969 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-06-13T12:16:52.164 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:16:52.168 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:16:52.169 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:16:52.170 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:16:52.170 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:16:52.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-06-13T12:16:59.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2024-06-13T12:17:05.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2024-06-13T12:17:07.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:17:07.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:17:07.470 INFO:tasks.ceph.mds.d.smithi053.stderr:2024-06-13T12:17:07.471+0000 7fc687bad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46109) UID: 0 2024-06-13T12:17:07.471 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T12:17:07.471+0000 7fe599183640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46109) UID: 0 2024-06-13T12:17:12.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2024-06-13T12:17:19.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2024-06-13T12:17:25.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2024-06-13T12:17:32.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2024-06-13T12:17:38.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2024-06-13T12:17:45.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2024-06-13T12:17:52.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2024-06-13T12:17:58.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2024-06-13T12:18:05.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2024-06-13T12:18:06.235 INFO:teuthology.orchestra.run.smithi043.stdout:generic/241 74s 2024-06-13T12:18:06.244 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/241 2024-06-13T12:18:06.244 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:06.248 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:06.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:06.678 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-06-13T12:18:07.177 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:07.184 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:07.184 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:07.186 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:07.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:07.845 INFO:teuthology.orchestra.run.smithi043.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:07.855 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/242 2024-06-13T12:18:07.855 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/242 2024-06-13T12:18:07.855 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:07.866 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:08.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:08.099 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-06-13T12:18:08.442 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:08.446 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:08.446 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:08.449 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:08.449 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:08.808 INFO:teuthology.orchestra.run.smithi043.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/243 2024-06-13T12:18:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/243 2024-06-13T12:18:08.817 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:08.819 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:08.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:08.996 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-06-13T12:18:09.267 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:09.271 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:09.271 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:09.272 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:09.272 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:09.487 INFO:teuthology.orchestra.run.smithi043.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:18:09.492 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/244 2024-06-13T12:18:09.492 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/244 2024-06-13T12:18:09.492 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:09.494 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:09.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:09.519 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-06-13T12:18:09.708 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:09.712 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:09.713 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:09.714 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:09.714 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:10.010 INFO:teuthology.orchestra.run.smithi043.stdout:generic/245 1s 2024-06-13T12:18:10.017 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/245 2024-06-13T12:18:10.017 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:10.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:10.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:10.070 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-06-13T12:18:10.484 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:10.488 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:10.488 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:10.489 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:10.489 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:10.743 INFO:teuthology.orchestra.run.smithi043.stdout:generic/246 0s 2024-06-13T12:18:10.749 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/246 2024-06-13T12:18:10.749 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:10.752 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:10.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:10.810 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-06-13T12:18:11.211 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:11.215 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:11.216 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:11.217 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:11.217 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:11.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2024-06-13T12:18:16.544 INFO:teuthology.orchestra.run.smithi043.stdout:generic/247 5s 2024-06-13T12:18:16.551 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/247 2024-06-13T12:18:16.551 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:16.553 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:16.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:16.562 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-06-13T12:18:16.751 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:16.755 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:16.755 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:16.756 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:16.756 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:17.010 INFO:teuthology.orchestra.run.smithi043.stdout:generic/248 1s 2024-06-13T12:18:17.016 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/248 2024-06-13T12:18:17.016 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:17.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:17.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:17.043 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-06-13T12:18:17.226 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:17.230 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:17.230 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:17.231 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:17.231 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:17.624 INFO:teuthology.orchestra.run.smithi043.stdout:generic/249 0s 2024-06-13T12:18:17.630 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/249 2024-06-13T12:18:17.631 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:17.633 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:17.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:17.681 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-06-13T12:18:18.112 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:18.116 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:18.116 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:18.117 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:18.117 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:18.372 INFO:teuthology.orchestra.run.smithi043.stdout:generic/250 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T12:18:18.377 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/250 2024-06-13T12:18:18.377 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/250 2024-06-13T12:18:18.377 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:18.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:18.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:18.393 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-06-13T12:18:18.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2024-06-13T12:18:18.591 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:18.595 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:18.596 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:18.596 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:18.597 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:18.918 INFO:teuthology.orchestra.run.smithi043.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:18.926 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/251 2024-06-13T12:18:18.926 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/251 2024-06-13T12:18:18.926 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:18.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:18.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:18.940 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-06-13T12:18:19.118 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:19.122 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:19.122 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:19.123 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:19.124 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:19.357 INFO:teuthology.orchestra.run.smithi043.stdout:generic/252 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T12:18:19.362 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/252 2024-06-13T12:18:19.362 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/252 2024-06-13T12:18:19.362 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:19.365 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:19.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:19.378 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-06-13T12:18:19.564 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:19.568 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:19.569 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:19.569 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:19.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:19.916 INFO:teuthology.orchestra.run.smithi043.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:19.926 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/253 2024-06-13T12:18:19.926 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/253 2024-06-13T12:18:19.926 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:19.939 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:20.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:20.188 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-06-13T12:18:20.395 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:20.399 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:20.399 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:20.400 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:20.400 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:20.788 INFO:teuthology.orchestra.run.smithi043.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:20.800 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/254 2024-06-13T12:18:20.800 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/254 2024-06-13T12:18:20.800 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:20.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:21.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:21.040 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-06-13T12:18:21.246 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:21.250 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:21.251 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:21.252 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:21.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:21.570 INFO:teuthology.orchestra.run.smithi043.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:18:21.575 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/255 2024-06-13T12:18:21.575 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/255 2024-06-13T12:18:21.576 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:21.578 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:21.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:21.631 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-06-13T12:18:22.079 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:22.083 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:22.084 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:22.085 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:22.085 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:22.623 INFO:teuthology.orchestra.run.smithi043.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:18:22.628 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/256 2024-06-13T12:18:22.628 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/256 2024-06-13T12:18:22.628 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:22.631 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:22.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:22.649 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-06-13T12:18:22.841 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:22.845 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:22.846 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:22.846 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:23.801 INFO:teuthology.orchestra.run.smithi043.stdout:generic/257 1s 2024-06-13T12:18:23.808 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/257 2024-06-13T12:18:23.808 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:23.810 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:23.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:23.875 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-06-13T12:18:24.380 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:24.384 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:24.385 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:24.386 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:24.386 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:24.599 INFO:teuthology.orchestra.run.smithi043.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-06-13T12:18:24.604 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/258 2024-06-13T12:18:24.604 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/258 2024-06-13T12:18:24.604 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:24.607 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:24.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:24.628 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-06-13T12:18:24.816 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:24.820 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:24.820 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:24.821 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:24.821 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:25.171 INFO:teuthology.orchestra.run.smithi043.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:25.179 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/259 2024-06-13T12:18:25.179 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/259 2024-06-13T12:18:25.179 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:25.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2024-06-13T12:18:25.191 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:25.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:25.234 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-06-13T12:18:25.595 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:25.599 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:25.600 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:25.601 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:25.601 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:25.883 INFO:teuthology.orchestra.run.smithi043.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:25.890 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/260 2024-06-13T12:18:25.890 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/260 2024-06-13T12:18:25.890 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:25.893 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:25.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:25.904 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-06-13T12:18:26.083 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:26.087 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:26.087 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:26.088 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:26.088 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:26.450 INFO:teuthology.orchestra.run.smithi043.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:26.458 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/261 2024-06-13T12:18:26.458 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/261 2024-06-13T12:18:26.458 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:26.467 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:26.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:26.523 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-06-13T12:18:26.879 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:26.883 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:26.883 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:26.884 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:26.884 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:27.260 INFO:teuthology.orchestra.run.smithi043.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:18:27.273 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/262 2024-06-13T12:18:27.273 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/262 2024-06-13T12:18:27.273 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:18:27.276 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:27.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:18:27.335 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-06-13T12:18:27.690 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:18:27.694 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:18:27.694 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:18:27.695 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:18:27.695 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:18:31.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2024-06-13T12:18:38.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-06-13T12:18:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2024-06-13T12:18:51.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2024-06-13T12:18:58.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-06-13T12:19:00.558 INFO:teuthology.orchestra.run.smithi043.stdout:generic/263 33s 2024-06-13T12:19:00.564 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/263 2024-06-13T12:19:00.564 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:00.567 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:00.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:00.627 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-06-13T12:19:01.040 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:01.044 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:01.044 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:01.045 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:01.046 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:01.401 INFO:teuthology.orchestra.run.smithi043.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:01.408 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/264 2024-06-13T12:19:01.411 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/264 2024-06-13T12:19:01.411 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:01.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:01.630 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-06-13T12:19:01.904 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:01.908 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:01.908 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:01.909 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:01.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:02.309 INFO:teuthology.orchestra.run.smithi043.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:02.317 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/265 2024-06-13T12:19:02.318 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/265 2024-06-13T12:19:02.318 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:02.325 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:02.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:02.533 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-06-13T12:19:02.808 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:02.812 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:02.812 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:02.813 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:03.182 INFO:teuthology.orchestra.run.smithi043.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:03.191 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/266 2024-06-13T12:19:03.192 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/266 2024-06-13T12:19:03.192 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:03.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:03.449 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-06-13T12:19:03.674 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:03.678 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:03.678 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:03.679 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:04.061 INFO:teuthology.orchestra.run.smithi043.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:04.068 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/267 2024-06-13T12:19:04.069 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/267 2024-06-13T12:19:04.069 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:04.073 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:04.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:04.269 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-06-13T12:19:04.499 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:04.503 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:04.504 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:04.505 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:04.505 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:04.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2024-06-13T12:19:04.906 INFO:teuthology.orchestra.run.smithi043.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:04.916 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/268 2024-06-13T12:19:04.916 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/268 2024-06-13T12:19:04.916 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:04.918 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:05.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:05.037 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-06-13T12:19:05.353 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:05.357 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:05.357 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:05.359 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:05.359 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:05.573 INFO:teuthology.orchestra.run.smithi043.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:19:05.577 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/269 2024-06-13T12:19:05.578 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/269 2024-06-13T12:19:05.578 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:05.580 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:05.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:05.593 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-06-13T12:19:05.774 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:05.777 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:05.778 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:05.779 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:05.779 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:05.992 INFO:teuthology.orchestra.run.smithi043.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:19:05.997 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/270 2024-06-13T12:19:05.997 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/270 2024-06-13T12:19:05.997 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:06.000 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:06.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:06.012 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-06-13T12:19:06.199 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:06.203 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:06.203 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:06.204 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:06.592 INFO:teuthology.orchestra.run.smithi043.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:06.599 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/271 2024-06-13T12:19:06.599 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/271 2024-06-13T12:19:06.599 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:06.605 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:06.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:06.816 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-06-13T12:19:07.044 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:07.047 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:07.048 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:07.049 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:07.049 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:07.450 INFO:teuthology.orchestra.run.smithi043.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:07.459 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/272 2024-06-13T12:19:07.459 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/272 2024-06-13T12:19:07.459 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:07.465 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:07.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:07.668 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-06-13T12:19:07.907 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:07.911 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:07.911 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:07.913 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:07.913 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:08.143 INFO:teuthology.orchestra.run.smithi043.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:19:08.148 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/273 2024-06-13T12:19:08.148 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/273 2024-06-13T12:19:08.148 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:08.150 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:08.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:08.176 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-06-13T12:19:08.366 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:08.370 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:08.370 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:08.371 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:08.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:08.611 INFO:teuthology.orchestra.run.smithi043.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-06-13T12:19:08.616 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/274 2024-06-13T12:19:08.616 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/274 2024-06-13T12:19:08.617 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:08.619 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:08.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:08.634 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-06-13T12:19:08.829 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:08.833 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:08.833 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:08.834 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:08.835 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:09.058 INFO:teuthology.orchestra.run.smithi043.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-06-13T12:19:09.063 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/275 2024-06-13T12:19:09.063 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/275 2024-06-13T12:19:09.063 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:09.065 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:09.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:09.078 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-06-13T12:19:09.267 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:09.271 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:09.272 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:09.273 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:09.273 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:09.659 INFO:teuthology.orchestra.run.smithi043.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:09.668 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/276 2024-06-13T12:19:09.668 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/276 2024-06-13T12:19:09.668 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:09.670 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:09.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:09.882 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-06-13T12:19:10.095 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:10.098 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:10.099 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:10.100 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:10.100 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:10.336 INFO:teuthology.orchestra.run.smithi043.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-06-13T12:19:10.341 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/277 2024-06-13T12:19:10.342 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/277 2024-06-13T12:19:10.342 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:10.344 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:10.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:10.362 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-06-13T12:19:10.556 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:10.560 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:10.560 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:10.561 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:10.562 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:10.934 INFO:teuthology.orchestra.run.smithi043.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:10.945 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/278 2024-06-13T12:19:10.945 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/278 2024-06-13T12:19:10.945 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:10.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:11.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:11.162 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-06-13T12:19:11.387 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:11.391 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:11.392 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:11.392 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:11.393 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:11.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2024-06-13T12:19:11.793 INFO:teuthology.orchestra.run.smithi043.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:11.805 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/279 2024-06-13T12:19:11.805 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/279 2024-06-13T12:19:11.805 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:11.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:12.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:12.005 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-06-13T12:19:12.221 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:12.225 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:12.225 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:12.226 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:12.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:12.461 INFO:teuthology.orchestra.run.smithi043.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-06-13T12:19:12.467 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/280 2024-06-13T12:19:12.467 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/280 2024-06-13T12:19:12.467 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:12.469 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:12.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:12.482 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-06-13T12:19:12.674 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:12.678 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:12.678 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:12.679 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:12.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:13.064 INFO:teuthology.orchestra.run.smithi043.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:13.075 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/281 2024-06-13T12:19:13.075 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/281 2024-06-13T12:19:13.075 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:13.082 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:13.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:13.247 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-06-13T12:19:13.516 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:13.520 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:13.521 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:13.522 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:13.522 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:13.901 INFO:teuthology.orchestra.run.smithi043.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:13.910 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/282 2024-06-13T12:19:13.910 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/282 2024-06-13T12:19:13.910 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:13.916 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:14.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:14.094 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-06-13T12:19:14.344 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:14.348 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:14.348 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:14.350 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:14.350 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:14.744 INFO:teuthology.orchestra.run.smithi043.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:14.754 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/283 2024-06-13T12:19:14.754 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/283 2024-06-13T12:19:14.755 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:14.759 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:14.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:14.960 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-06-13T12:19:15.192 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:15.196 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:15.196 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:15.197 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:15.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:15.567 INFO:teuthology.orchestra.run.smithi043.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:15.580 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/284 2024-06-13T12:19:15.580 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/284 2024-06-13T12:19:15.580 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:15.584 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:15.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:15.825 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-06-13T12:19:16.051 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:16.055 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:16.055 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:16.056 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:16.056 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:17.111 INFO:teuthology.orchestra.run.smithi043.stdout:generic/285 1s 2024-06-13T12:19:17.117 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/285 2024-06-13T12:19:17.117 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:17.120 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:17.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:17.386 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-06-13T12:19:17.791 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:17.794 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:17.795 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:17.796 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:17.796 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:18.030 INFO:teuthology.orchestra.run.smithi043.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:19:18.035 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/286 2024-06-13T12:19:18.035 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/286 2024-06-13T12:19:18.035 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:18.038 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:18.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:18.070 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-06-13T12:19:18.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-06-13T12:19:18.337 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:18.345 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:18.346 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:18.347 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:18.347 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:18.865 INFO:teuthology.orchestra.run.smithi043.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:18.873 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/287 2024-06-13T12:19:18.873 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/287 2024-06-13T12:19:18.873 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:18.880 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:19.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:19.078 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-06-13T12:19:19.425 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:19.434 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:19.435 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:19.436 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:19.888 INFO:teuthology.orchestra.run.smithi043.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:19.910 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/288 2024-06-13T12:19:19.910 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/288 2024-06-13T12:19:19.910 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:19.914 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:19.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:19.937 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-06-13T12:19:20.213 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:20.219 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:20.219 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:20.220 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:20.220 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:20.710 INFO:teuthology.orchestra.run.smithi043.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:20.724 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/289 2024-06-13T12:19:20.724 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/289 2024-06-13T12:19:20.724 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:20.734 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:20.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:20.912 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-06-13T12:19:21.265 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:21.271 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:21.271 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:21.273 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:21.273 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:21.777 INFO:teuthology.orchestra.run.smithi043.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:21.791 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/290 2024-06-13T12:19:21.791 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/290 2024-06-13T12:19:21.792 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:21.797 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:21.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:21.957 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-06-13T12:19:22.338 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:22.343 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:22.343 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:22.344 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:22.344 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:22.776 INFO:teuthology.orchestra.run.smithi043.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:22.787 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/291 2024-06-13T12:19:22.787 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/291 2024-06-13T12:19:22.787 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:22.790 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:22.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:22.986 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-06-13T12:19:23.239 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:23.243 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:23.243 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:23.244 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:23.244 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:23.609 INFO:teuthology.orchestra.run.smithi043.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:23.619 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/292 2024-06-13T12:19:23.619 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/292 2024-06-13T12:19:23.619 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:23.623 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:23.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:23.773 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-06-13T12:19:24.068 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:24.071 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:24.072 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:24.073 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:24.073 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:24.460 INFO:teuthology.orchestra.run.smithi043.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:24.468 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/293 2024-06-13T12:19:24.470 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/293 2024-06-13T12:19:24.470 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:24.480 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:24.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:24.567 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-06-13T12:19:24.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2024-06-13T12:19:24.889 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:24.893 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:24.893 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:24.894 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:24.894 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:generic/294 1s 2024-06-13T12:19:25.412 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/294 2024-06-13T12:19:25.412 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:25.418 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:25.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:25.441 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-06-13T12:19:25.793 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:25.797 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:25.797 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:25.798 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:25.798 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:26.188 INFO:teuthology.orchestra.run.smithi043.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:26.200 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/295 2024-06-13T12:19:26.200 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/295 2024-06-13T12:19:26.200 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:26.206 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:26.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:26.357 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-06-13T12:19:26.646 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:26.650 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:26.651 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:26.652 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:26.652 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:27.014 INFO:teuthology.orchestra.run.smithi043.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:27.021 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/296 2024-06-13T12:19:27.022 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/296 2024-06-13T12:19:27.022 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:27.025 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:27.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:27.130 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-06-13T12:19:27.467 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:27.472 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:27.472 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:27.473 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:27.473 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:27.883 INFO:teuthology.orchestra.run.smithi043.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:27.895 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/297 2024-06-13T12:19:27.896 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/297 2024-06-13T12:19:27.896 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:27.906 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:27.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:27.981 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-06-13T12:19:28.295 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:28.299 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:28.299 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:28.300 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:28.300 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:28.676 INFO:teuthology.orchestra.run.smithi043.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:28.691 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/298 2024-06-13T12:19:28.691 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/298 2024-06-13T12:19:28.691 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:28.693 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:28.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:28.895 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-06-13T12:19:29.142 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:29.146 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:29.146 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:29.147 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:29.147 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:29.435 INFO:teuthology.orchestra.run.smithi043.stdout:generic/299 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T12:19:29.440 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/299 2024-06-13T12:19:29.440 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/299 2024-06-13T12:19:29.440 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:29.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:29.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:29.461 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-06-13T12:19:29.650 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:29.654 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:29.654 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:29.655 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:29.655 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:29.923 INFO:teuthology.orchestra.run.smithi043.stdout:generic/300 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T12:19:29.928 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/300 2024-06-13T12:19:29.929 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/300 2024-06-13T12:19:29.929 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:29.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:29.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:29.951 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-06-13T12:19:30.141 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:30.145 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:30.145 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:30.146 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:30.146 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:30.518 INFO:teuthology.orchestra.run.smithi043.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:30.526 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/301 2024-06-13T12:19:30.526 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/301 2024-06-13T12:19:30.526 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:30.530 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:30.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:30.655 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-06-13T12:19:30.961 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:30.965 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:30.965 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:30.966 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:30.966 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:31.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2024-06-13T12:19:31.349 INFO:teuthology.orchestra.run.smithi043.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:31.362 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/302 2024-06-13T12:19:31.362 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/302 2024-06-13T12:19:31.362 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:31.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:31.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:31.493 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-06-13T12:19:31.795 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:31.799 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:31.800 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:31.801 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:31.801 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:32.052 INFO:teuthology.orchestra.run.smithi043.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-06-13T12:19:32.058 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/303 2024-06-13T12:19:32.058 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/303 2024-06-13T12:19:32.058 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:32.060 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:32.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:32.115 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-06-13T12:19:32.532 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:32.536 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:32.536 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:32.537 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:32.538 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:32.788 INFO:teuthology.orchestra.run.smithi043.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-06-13T12:19:32.794 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/304 2024-06-13T12:19:32.794 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/304 2024-06-13T12:19:32.794 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:32.796 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:32.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:32.854 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-06-13T12:19:33.281 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:33.285 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:33.285 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:33.286 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:33.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:33.663 INFO:teuthology.orchestra.run.smithi043.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-06-13T12:19:33.675 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/305 2024-06-13T12:19:33.675 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/305 2024-06-13T12:19:33.675 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:33.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:33.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:33.913 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-06-13T12:19:34.135 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:34.139 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:34.139 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:34.140 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:34.140 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:34.670 INFO:teuthology.orchestra.run.smithi043.stdout:generic/306 0s 2024-06-13T12:19:34.689 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/306 2024-06-13T12:19:34.689 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:34.691 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:34.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:34.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-06-13T12:19:35.366 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:35.369 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:35.370 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:35.371 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:35.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:36.880 INFO:teuthology.orchestra.run.smithi043.stdout:generic/307 1s 2024-06-13T12:19:36.887 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/307 2024-06-13T12:19:36.887 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:36.889 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:36.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:36.899 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-06-13T12:19:37.086 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:37.090 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:37.091 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:37.092 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:37.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:37.342 INFO:teuthology.orchestra.run.smithi043.stdout:generic/308 0s 2024-06-13T12:19:37.348 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/308 2024-06-13T12:19:37.348 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:37.351 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:37.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-06-13T12:19:37.559 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:37.564 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:37.564 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:37.564 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:37.564 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:37.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-06-13T12:19:38.856 INFO:teuthology.orchestra.run.smithi043.stdout:generic/309 1s 2024-06-13T12:19:38.863 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/309 2024-06-13T12:19:38.864 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:19:38.866 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:38.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:19:38.918 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-06-13T12:19:39.350 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:19:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:19:39.354 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:19:39.355 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:19:39.355 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:19:44.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2024-06-13T12:19:51.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2024-06-13T12:19:57.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-06-13T12:20:04.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2024-06-13T12:20:10.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2024-06-13T12:20:17.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2024-06-13T12:20:18.842 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T12:20:18.841+0000 7f4aa3f08640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46113) UID: 0 2024-06-13T12:20:18.842 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T12:20:18.841+0000 7ff89b921640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46113) UID: 0 2024-06-13T12:20:18.842 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T12:20:18.841+0000 7f8ff812c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46113) UID: 0 2024-06-13T12:20:24.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2024-06-13T12:20:30.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2024-06-13T12:20:37.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2024-06-13T12:20:44.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2024-06-13T12:20:50.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2024-06-13T12:20:55.700 INFO:teuthology.orchestra.run.smithi043.stdout:generic/310 76s 2024-06-13T12:20:55.706 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/310 2024-06-13T12:20:55.706 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:20:55.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:20:55.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:20:55.875 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-06-13T12:20:56.276 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:20:56.284 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:20:56.285 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:20:56.290 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:20:56.290 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:20:56.614 INFO:teuthology.orchestra.run.smithi043.stdout:generic/311 [not run] require 172.21.15.43:6789:/scratch to be valid block disk 2024-06-13T12:20:56.619 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/311 2024-06-13T12:20:56.619 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/311 2024-06-13T12:20:56.619 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:20:56.621 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:20:56.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:20:56.637 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-06-13T12:20:56.823 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:20:56.827 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:20:56.827 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:20:56.828 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:20:56.828 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:20:57.045 INFO:teuthology.orchestra.run.smithi043.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-06-13T12:20:57.050 INFO:teuthology.orchestra.run.smithi043.stdout:Ran: generic/312 2024-06-13T12:20:57.050 INFO:teuthology.orchestra.run.smithi043.stdout:Not run: generic/312 2024-06-13T12:20:57.051 INFO:teuthology.orchestra.run.smithi043.stdout:Passed all 1 tests 2024-06-13T12:20:57.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:20:57.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-06-13T12:20:57.068 DEBUG:teuthology.orchestra.run.smithi043:> (cd /tmp/tmp.dHWHNRE83Nxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-06-13T12:20:57.244 INFO:teuthology.orchestra.run.smithi043.stdout:FSTYP -- ceph 2024-06-13T12:20:57.247 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM -- Linux/x86_64 smithi043 5.14.0-457.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 30 22:48:58 UTC 2024 2024-06-13T12:20:57.248 INFO:teuthology.orchestra.run.smithi043.stdout:MKFS_OPTIONS -- 172.21.15.43:6789:/scratch 2024-06-13T12:20:57.249 INFO:teuthology.orchestra.run.smithi043.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCv2Wpm/kgrJRAARRBD+M/7HDqzT27L7FFQpg== -o context=system_u:object_r:root_t:s0 172.21.15.43:6789:/scratch /tmp/tmp.SrWmQymjYxscratch 2024-06-13T12:20:57.249 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-06-13T12:20:57.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2024-06-13T12:20:57.277 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-06-13T12:20:57.278 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T12:20:57.278 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T12:20:57.294 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T12:20:57.295 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T12:20:57.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-13T12:20:57.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.683+0000 7f00f1dc1640 1 Processor -- start 2024-06-13T12:20:57.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.683+0000 7f00f1dc1640 1 -- start start 2024-06-13T12:20:57.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.684+0000 7f00f1dc1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f00ec155420 0x7f00ec0ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.684+0000 7f00f1dc1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec0d31a0 0x7f00ec0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.684+0000 7f00f1dc1640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ec0aa5d0 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.684+0000 7f00f1dc1640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f00ec155800 con 0x7f00ec155420 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.684+0000 7f00f1dc1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec0aa870 con 0x7f00ec0d31a0 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eb7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f00ec155420 0x7f00ec0ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eaffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f00ec0ae9c0 0x7f00ec0d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35220/0 (socket says 172.21.15.43:35220) 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eaffd640 1 -- 172.21.15.43:0/3788123123 learned_addr learned my addr 172.21.15.43:0/3788123123 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00ebfff640 1 --2- 172.21.15.43:0/3788123123 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec0d31a0 0x7f00ec0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eb7fe640 1 -- 172.21.15.43:0/3788123123 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec0d31a0 msgr2=0x7f00ec0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eb7fe640 1 --2- 172.21.15.43:0/3788123123 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec0d31a0 0x7f00ec0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eb7fe640 1 -- 172.21.15.43:0/3788123123 >> v1:172.21.15.43:6789/0 conn(0x7f00ec0ae9c0 legacy=0x7f00ec0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T12:20:57.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.685+0000 7f00eb7fe640 1 -- 172.21.15.43:0/3788123123 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec0aab50 con 0x7f00ec155420 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00eb7fe640 1 --2- 172.21.15.43:0/3788123123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec155420 0x7f00ec0ae480 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0097a0 tx=0x7f00dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecdc43692e5ffdf server_cookie=0 in_seq=0 out_seq=0 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00ea7fc640 1 -- 172.21.15.43:0/3788123123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc037070 con 0x7f00ec155420 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00ea7fc640 1 -- 172.21.15.43:0/3788123123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc032440 con 0x7f00ec155420 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00ea7fc640 1 -- 172.21.15.43:0/3788123123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc032810 con 0x7f00ec155420 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 -- 172.21.15.43:0/3788123123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec155420 msgr2=0x7f00ec0ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/3788123123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec155420 0x7f00ec0ae480 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0097a0 tx=0x7f00dc02a180 comp rx=0 tx=0).stop 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 -- 172.21.15.43:0/3788123123 shutdown_connections 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/3788123123 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec0d31a0 0x7f00ec0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/3788123123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec155420 0x7f00ec0ae480 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 -- 172.21.15.43:0/3788123123 >> 172.21.15.43:0/3788123123 conn(0x7f00ec067640 msgr2=0x7f00ec0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 -- 172.21.15.43:0/3788123123 shutdown_connections 2024-06-13T12:20:57.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.686+0000 7f00f1dc1640 1 -- 172.21.15.43:0/3788123123 wait complete. 2024-06-13T12:20:57.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.688+0000 7f00f1dc1640 1 Processor -- start 2024-06-13T12:20:57.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.688+0000 7f00f1dc1640 1 -- start start 2024-06-13T12:20:57.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.688+0000 7f00f1dc1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 0x7f00ec0d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.688+0000 7f00f1dc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ec0d31a0 0x7f00ec162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00f1dc1640 1 --2- >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec155420 0x7f00ec162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00f1dc1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec0ab630 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00f1dc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec0ab110 con 0x7f00ec0d31a0 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00f1dc1640 1 -- --> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec0adfb0 con 0x7f00ec155420 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 0x7f00ec0d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 0x7f00ec0d1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43768/0 (socket says 172.21.15.43:43768) 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 -- 172.21.15.43:0/1244752885 learned_addr learned my addr 172.21.15.43:0/1244752885 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00ebfff640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec155420 0x7f00ec162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eaffd640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ec0d31a0 0x7f00ec162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 -- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec155420 msgr2=0x7f00ec162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec155420 0x7f00ec162580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 -- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ec0d31a0 msgr2=0x7f00ec162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ec0d31a0 0x7f00ec162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 -- 172.21.15.43:0/1244752885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec15b0d0 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00ebfff640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec155420 0x7f00ec162580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00eb7fe640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 0x7f00ec0d1ed0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0098c0 tx=0x7f00dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc037040 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc030500 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec15b3b0 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0308d0 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.689+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec15b970 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.690+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ec04ffb0 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.691+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00dc044020 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.691+0000 7f00d3fff640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f00d806be30 0x7f00d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T12:20:57.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.691+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f00dc0ab300 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.692+0000 7f00eaffd640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f00d806be30 0x7f00d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T12:20:57.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.692+0000 7f00eaffd640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f00d806be30 0x7f00d806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f00ec15cd90 tx=0x7f00e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T12:20:57.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.696+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f00dc079a60 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.896+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00ec0ab920 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.896+0000 7f00d3fff640 1 -- 172.21.15.43:0/1244752885 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f00dc079360 con 0x7f00ec0ae9c0 2024-06-13T12:20:57.896 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f00d806be30 msgr2=0x7f00d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f00d806be30 0x7f00d806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f00ec15cd90 tx=0x7f00e0009040 comp rx=0 tx=0).stop 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 msgr2=0x7f00ec0d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 0x7f00ec0d1ed0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0098c0 tx=0x7f00dc0046c0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 shutdown_connections 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:6832/3639668584,v1:172.21.15.53:6833/3639668584] conn(0x7f00d806be30 0x7f00d806e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] conn(0x7f00ec155420 0x7f00ec162580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00ec0d31a0 0x7f00ec162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 --2- 172.21.15.43:0/1244752885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00ec0ae9c0 0x7f00ec0d1ed0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.898+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 >> 172.21.15.43:0/1244752885 conn(0x7f00ec067640 msgr2=0x7f00ec070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.899+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 shutdown_connections 2024-06-13T12:20:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-06-13T12:20:57.899+0000 7f00f1dc1640 1 -- 172.21.15.43:0/1244752885 wait complete. 2024-06-13T12:20:57.909 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-13T12:20:57.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T12:20:57.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-06-13T12:20:57.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T12:20:57.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T12:20:57.936 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-13T12:20:58.000 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-06-13T12:20:58.000 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T12:20:58.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498864k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20548 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249432k,nr_inodes=812358,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498864k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.43:6789:/test /tmp/tmp.nZPIJ9BvOktest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=3ec2c561-6fdb-4bfc-ae48-dfea33a4d8a5,acl 0 0 2024-06-13T12:20:58.057 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-06-13T12:20:58.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T12:20:58.057 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-13T12:20:58.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T12:20:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-13T12:20:58.114 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T12:20:58.114 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T12:20:58.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498864k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17860 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249432k,nr_inodes=812358,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498864k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-13T12:20:58.143 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T12:20:58.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T12:20:58.144 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-13T12:20:58.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T12:20:58.206 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-13T12:20:58.206 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-06-13T12:20:58.206 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T12:20:58.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498864k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17860 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249432k,nr_inodes=812358,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498864k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-13T12:20:58.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-06-13T12:20:58.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T12:20:58.262 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-13T12:20:58.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T12:20:58.319 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-13T12:20:59.930 INFO:tasks.ceph.osd.0:Sent signal 15 2024-06-13T12:20:59.931 INFO:tasks.ceph.osd.1:Sent signal 15 2024-06-13T12:20:59.931 INFO:tasks.ceph.osd.2:Sent signal 15 2024-06-13T12:20:59.931 INFO:tasks.ceph.osd.3:Sent signal 15 2024-06-13T12:20:59.931 INFO:tasks.ceph.osd.4:Sent signal 15 2024-06-13T12:20:59.932 INFO:tasks.ceph.osd.6:Sent signal 15 2024-06-13T12:20:59.932 INFO:tasks.ceph.osd.7:Sent signal 15 2024-06-13T12:20:59.932 INFO:tasks.ceph.mds.a:Sent signal 15 2024-06-13T12:20:59.932 INFO:tasks.ceph.mds.c:Sent signal 15 2024-06-13T12:20:59.932 INFO:tasks.ceph.mds.b:Sent signal 15 2024-06-13T12:20:59.933 INFO:tasks.ceph.mds.d:Sent signal 15 2024-06-13T12:20:59.933 INFO:tasks.ceph.mon.a:Sent signal 15 2024-06-13T12:20:59.933 INFO:tasks.ceph.mon.b:Sent signal 15 2024-06-13T12:20:59.933 INFO:tasks.ceph.mon.c:Sent signal 15 2024-06-13T12:20:59.933 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-06-13T12:20:59.934 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-06-13T12:20:59.934 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T12:20:59.933+0000 7f8ff812c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 38160) UID: 0 2024-06-13T12:20:59.934 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T12:20:59.933+0000 7f8ff812c640 -1 osd.4 41 *** Got signal Terminated *** 2024-06-13T12:20:59.934 INFO:tasks.ceph.osd.4.smithi053.stderr:2024-06-13T12:20:59.933+0000 7f8ff812c640 -1 osd.4 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.935 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T12:20:59.933+0000 7f4aa3f08640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 38167) UID: 0 2024-06-13T12:20:59.935 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T12:20:59.933+0000 7f4aa3f08640 -1 osd.6 41 *** Got signal Terminated *** 2024-06-13T12:20:59.935 INFO:tasks.ceph.osd.6.smithi053.stderr:2024-06-13T12:20:59.933+0000 7f4aa3f08640 -1 osd.6 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.935 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T12:20:59.933+0000 7ff89b921640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 38166) UID: 0 2024-06-13T12:20:59.936 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T12:20:59.933+0000 7ff89b921640 -1 osd.7 41 *** Got signal Terminated *** 2024-06-13T12:20:59.936 INFO:tasks.ceph.osd.7.smithi053.stderr:2024-06-13T12:20:59.933+0000 7ff89b921640 -1 osd.7 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.936 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T12:20:59.934+0000 7fe599183640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 43983) UID: 0 2024-06-13T12:20:59.936 INFO:tasks.ceph.mds.b.smithi053.stderr:2024-06-13T12:20:59.934+0000 7fe599183640 -1 mds.b *** got signal Terminated *** 2024-06-13T12:20:59.936 INFO:tasks.ceph.mds.d.smithi053.stderr:2024-06-13T12:20:59.934+0000 7fc687bad640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 43982) UID: 0 2024-06-13T12:20:59.936 INFO:tasks.ceph.mds.d.smithi053.stderr:2024-06-13T12:20:59.934+0000 7fc687bad640 -1 mds.d *** got signal Terminated *** 2024-06-13T12:20:59.937 INFO:tasks.ceph.mon.b.smithi053.stderr:2024-06-13T12:20:59.935+0000 7ff1ad856640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 37580) UID: 0 2024-06-13T12:20:59.937 INFO:tasks.ceph.mon.b.smithi053.stderr:2024-06-13T12:20:59.935+0000 7ff1ad856640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-06-13T12:20:59.937 INFO:tasks.ceph.mon.c.smithi053.stderr:2024-06-13T12:20:59.935+0000 7f1ba6688640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 37581) UID: 0 2024-06-13T12:20:59.937 INFO:tasks.ceph.mon.c.smithi053.stderr:2024-06-13T12:20:59.935+0000 7f1ba6688640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-06-13T12:20:59.937 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T12:20:59.935+0000 7fd48c746640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 37585) UID: 0 2024-06-13T12:20:59.938 INFO:tasks.ceph.mgr.x.smithi053.stderr:2024-06-13T12:20:59.935+0000 7fd48c746640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-13T12:20:59.938 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T12:20:59.931+0000 7f1526e6e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37887) UID: 0 2024-06-13T12:20:59.938 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T12:20:59.931+0000 7f1526e6e640 -1 osd.0 41 *** Got signal Terminated *** 2024-06-13T12:20:59.938 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-06-13T12:20:59.931+0000 7f1526e6e640 -1 osd.0 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.938 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T12:20:59.932+0000 7fcd51f6f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37891) UID: 0 2024-06-13T12:20:59.939 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T12:20:59.932+0000 7fcd51f6f640 -1 osd.1 41 *** Got signal Terminated *** 2024-06-13T12:20:59.939 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-06-13T12:20:59.932+0000 7fcd51f6f640 -1 osd.1 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.939 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T12:20:59.932+0000 7f37c8ee6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 37893) UID: 0 2024-06-13T12:20:59.939 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T12:20:59.932+0000 7f37c8ee6640 -1 osd.2 41 *** Got signal Terminated *** 2024-06-13T12:20:59.940 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T12:20:59.932+0000 7fdae9a3f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37896) UID: 0 2024-06-13T12:20:59.940 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T12:20:59.932+0000 7fdae9a3f640 -1 osd.3 41 *** Got signal Terminated *** 2024-06-13T12:20:59.940 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-06-13T12:20:59.932+0000 7fdae9a3f640 -1 osd.3 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.940 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-06-13T12:20:59.932+0000 7f37c8ee6640 -1 osd.2 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T12:20:59.941 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-06-13T12:20:59.933+0000 7fd152d5b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 48738) UID: 0 2024-06-13T12:20:59.941 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-06-13T12:20:59.933+0000 7fd152d5b640 -1 mds.a *** got signal Terminated *** 2024-06-13T12:20:59.941 INFO:tasks.ceph.mds.c.smithi043.stderr:2024-06-13T12:20:59.933+0000 7f98d8243640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 48739) UID: 0 2024-06-13T12:20:59.941 INFO:tasks.ceph.mds.c.smithi043.stderr:2024-06-13T12:20:59.933+0000 7f98d8243640 -1 mds.c *** got signal Terminated *** 2024-06-13T12:20:59.941 INFO:tasks.ceph.mon.a.smithi043.stderr:2024-06-13T12:20:59.934+0000 7f34cf52f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 37614) UID: 0 2024-06-13T12:20:59.941 INFO:tasks.ceph.mon.a.smithi043.stderr:2024-06-13T12:20:59.934+0000 7f34cf52f640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-13T12:21:00.134 INFO:tasks.ceph.mgr.y.smithi043.stderr:daemon-helper: command crashed with signal 15 2024-06-13T12:23:39.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:23:39.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:23:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:ceph-osd: no process found 2024-06-13T12:26:14.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:26:14.408 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:26:44.465 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:26:44.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:27:14.528 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:27:14.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:27:44.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:27:44.596 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:28:14.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:28:14.666 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:28:44.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:28:44.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:29:14.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:29:14.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:29:44.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:29:44.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:30:14.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:30:14.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:30:45.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:30:45.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:31:15.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:31:15.078 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:31:45.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:31:45.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:32:15.230 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:32:15.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:32:45.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:32:45.306 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:33:15.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:33:15.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:33:45.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:33:45.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:34:15.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:34:15.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:34:45.582 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:34:45.585 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:35:15.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:35:15.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:35:45.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:35:45.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:36:15.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:36:15.787 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:36:45.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:36:45.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:37:15.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:37:15.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:37:45.980 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:37:45.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:38:16.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:38:16.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:38:46.131 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:38:46.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:39:16.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:39:16.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:39:46.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:39:46.270 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:40:16.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:40:16.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:40:46.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:40:46.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:41:16.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:41:16.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:41:46.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:41:46.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:42:16.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:42:16.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:42:46.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:42:46.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:43:16.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:43:16.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:43:46.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:43:46.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:44:16.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:44:16.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:44:46.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:44:46.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:45:17.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:45:17.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:45:47.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:45:47.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:46:17.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:46:17.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:46:47.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:46:47.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:47:17.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:47:17.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:47:47.502 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:47:47.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:48:17.574 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:48:17.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:48:47.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:48:47.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:49:17.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:49:17.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:49:47.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:49:47.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:50:17.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:50:17.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:50:47.930 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:50:47.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:51:18.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:51:18.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:51:48.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:51:48.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:52:18.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:52:18.149 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:52:48.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:52:48.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:53:18.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:53:18.283 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:53:48.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:53:48.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:54:18.440 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:54:18.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:54:48.505 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:54:48.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:55:18.568 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:55:18.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:55:48.639 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:55:48.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:56:18.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:56:18.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:56:48.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:56:48.802 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:57:18.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:57:18.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:57:48.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:57:48.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:58:19.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:58:19.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:58:49.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:58:49.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:59:19.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:59:19.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:59:49.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T12:59:49.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:00:19.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:00:19.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:00:49.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:00:49.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:01:19.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:01:19.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:01:49.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:01:49.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:02:19.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:02:19.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:02:49.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:02:49.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:03:19.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:03:19.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:03:49.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:03:49.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:04:19.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:04:19.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:04:50.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:04:50.020 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:05:20.088 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:05:20.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:05:50.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:05:50.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:06:20.230 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:06:20.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:06:50.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:06:50.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:07:20.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:07:20.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:07:50.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:07:50.465 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:08:20.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:08:20.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:08:50.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:08:50.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:09:20.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:09:20.691 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:09:50.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:09:50.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:10:20.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:10:20.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:10:50.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:10:50.890 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:11:20.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:11:20.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:11:51.022 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:11:51.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:12:21.101 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:12:21.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:12:51.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:12:51.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:13:21.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:13:21.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:13:51.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:13:51.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:14:21.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:14:21.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:14:51.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:14:51.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:15:21.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:15:21.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:15:51.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:15:51.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:16:21.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:16:21.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:16:51.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:16:51.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:17:21.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:17:21.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:17:51.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:17:51.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:18:22.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:18:22.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:18:52.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:18:52.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:19:22.155 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:19:22.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:19:52.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:19:52.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:20:22.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:20:22.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:20:52.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:20:52.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:21:22.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:21:22.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:21:52.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:21:52.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:22:22.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:22:22.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:22:52.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:22:52.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:23:22.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:23:22.787 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:23:52.855 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:23:52.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:24:23.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:24:23.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:24:53.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:24:53.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:25:23.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:25:23.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:25:53.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:25:53.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:26:23.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:26:23.306 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:26:53.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:26:53.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:27:23.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:27:23.449 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:27:53.515 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:27:53.519 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:28:23.588 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:28:23.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:28:53.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:28:53.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:29:23.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:29:23.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:29:53.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:29:53.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:30:23.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:30:23.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:30:54.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:30:54.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:31:24.076 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:31:24.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:31:54.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:31:54.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:32:24.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:32:24.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:32:54.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:32:54.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:33:24.355 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:33:24.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:33:54.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:33:54.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:34:24.514 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:34:24.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:34:54.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:34:54.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:35:24.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:35:24.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:35:54.725 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:35:54.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:36:24.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:36:24.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:36:54.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:36:54.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:37:24.937 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:37:24.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:37:55.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:37:55.013 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:38:25.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:38:25.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:38:55.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:38:55.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:39:25.233 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:39:25.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:39:55.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:39:55.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:40:25.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:40:25.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:40:55.469 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:40:55.473 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:41:25.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:41:25.558 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:41:55.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:41:55.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:42:25.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:42:25.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:42:55.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:42:55.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:43:25.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:43:25.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:43:56.079 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:43:56.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:44:26.151 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:44:26.159 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:44:56.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:44:56.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:45:26.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:45:26.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:45:56.367 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:45:56.370 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:46:26.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:46:26.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:46:56.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:46:56.647 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:47:26.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:47:26.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:47:56.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:47:56.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:48:26.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:48:26.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:48:56.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:48:56.958 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:49:27.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:49:27.043 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:49:57.104 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:49:57.107 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:50:27.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:50:27.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:50:57.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:50:57.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:51:27.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:51:27.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:51:57.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:51:57.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:52:27.485 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:52:27.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:52:57.748 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:52:57.752 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:53:27.827 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:53:27.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:53:57.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:53:57.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:54:27.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:54:27.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:54:58.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:54:58.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:55:28.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:55:28.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:55:58.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:55:58.221 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:56:28.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:56:28.310 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:56:58.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:56:58.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:57:28.574 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:57:28.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:57:58.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:57:58.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:58:28.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:58:28.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:58:58.825 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:58:58.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:59:28.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:59:28.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:59:58.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T13:59:58.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:00:29.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:00:29.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:00:59.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:00:59.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:01:29.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:01:29.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:01:59.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:01:59.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:02:29.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:02:29.331 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:02:59.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:02:59.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:03:29.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:03:29.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:03:59.537 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:03:59.543 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:04:29.605 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:04:29.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:04:59.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:04:59.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:05:29.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:05:29.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:05:59.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:05:59.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:06:29.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:06:29.890 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:06:59.958 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:06:59.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:07:30.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:07:30.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:08:00.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:08:00.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:08:30.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:08:30.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:09:00.245 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:09:00.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:09:30.317 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:09:30.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:10:00.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:10:00.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:10:30.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:10:30.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:11:00.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:11:00.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:11:30.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:11:30.640 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:12:00.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:12:00.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:12:30.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:12:30.781 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:13:00.852 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:13:00.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:13:30.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:13:30.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:14:01.029 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:14:01.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:14:31.101 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:14:31.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:15:01.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:15:01.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:15:31.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:15:31.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:16:01.325 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:16:01.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:16:31.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:16:31.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:17:01.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:17:01.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:17:31.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:17:31.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:18:01.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:18:01.615 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:18:31.684 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:18:31.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:19:01.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:19:01.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:19:31.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:19:31.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:20:01.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:20:01.903 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:20:31.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:20:31.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:21:02.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:21:02.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:21:32.105 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:21:32.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:22:02.176 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:22:02.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:22:32.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:22:32.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:23:02.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:23:02.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:23:32.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:23:32.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:24:02.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:24:02.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:24:32.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:24:32.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:25:02.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:25:02.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:25:32.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:25:32.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:26:02.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:26:02.802 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:26:32.889 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:26:32.893 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:27:02.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:27:02.971 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:27:33.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:27:33.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:28:03.170 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:28:03.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:28:33.272 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:28:33.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:29:03.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:29:03.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:29:33.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:29:33.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:30:03.734 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:30:03.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:30:33.805 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:30:33.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:31:03.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:31:03.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:31:33.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:31:33.971 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:32:04.048 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:32:04.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:32:34.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:32:34.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:33:04.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:33:04.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:33:34.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:33:34.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:34:04.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:34:04.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:34:34.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:34:34.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:35:04.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:35:04.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:35:34.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:35:34.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:36:04.790 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:36:04.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:36:34.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:36:34.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:37:04.937 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:37:04.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:37:34.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:37:35.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:38:05.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:38:05.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:38:35.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:38:35.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:39:05.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:39:05.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:39:35.285 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:39:35.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:40:05.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:40:05.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:40:35.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:40:35.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:41:05.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:41:05.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:41:35.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:41:35.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:42:05.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:42:05.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:42:35.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:42:35.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:43:05.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:43:05.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:43:36.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:43:36.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:44:06.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:44:06.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:44:36.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:44:36.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:45:06.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:45:06.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:45:36.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:45:36.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:46:06.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:46:06.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:46:36.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:46:36.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:47:06.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:47:06.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:47:36.611 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:47:36.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:48:06.684 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:48:06.688 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:48:36.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:48:36.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:49:06.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:49:06.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:49:36.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:49:36.911 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:50:06.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:50:06.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:50:37.041 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:50:37.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:51:07.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:51:07.143 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:51:37.203 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:51:37.207 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:52:07.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:52:07.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:52:37.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:52:37.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:53:07.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:53:07.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:53:37.474 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:53:37.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:54:07.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:54:07.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:54:37.609 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:54:37.613 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:55:07.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:55:07.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:55:37.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:55:37.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:56:07.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:56:07.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:56:37.892 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:56:37.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:57:07.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:57:07.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:57:38.045 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:57:38.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:58:08.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:58:08.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:58:38.199 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:58:38.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:59:08.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:59:08.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:59:38.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T14:59:38.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:00:08.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:00:08.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:00:38.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:00:38.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:01:08.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:01:08.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:01:38.641 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:01:38.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:02:08.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:02:08.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:02:38.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:02:38.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:03:08.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:03:08.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:03:38.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:03:38.946 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:04:09.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:04:09.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:04:39.079 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:04:39.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:05:09.144 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:05:09.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:05:39.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:05:39.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:06:09.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:06:09.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:06:39.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:06:39.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:07:09.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:07:09.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:07:39.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:07:39.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:08:09.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:08:09.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:08:39.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:08:39.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:09:09.736 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:09:09.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:09:39.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:09:39.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:10:09.880 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:10:09.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:10:39.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:10:39.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:11:10.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:11:10.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:11:40.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:11:40.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:12:10.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:12:10.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:12:40.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:12:40.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:13:10.312 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:13:10.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:13:40.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:13:40.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:14:10.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:14:10.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:14:40.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:14:40.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:15:10.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:15:10.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:15:40.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:15:40.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:16:10.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:16:10.731 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:16:40.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:16:40.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:17:10.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:17:10.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:17:40.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:17:40.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:18:11.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:18:11.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:18:41.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:18:41.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:19:11.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:19:11.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:19:41.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:19:41.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:20:11.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:20:11.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:20:41.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:20:41.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:21:11.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:21:11.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:21:41.638 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:21:41.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:22:11.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:22:11.731 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:22:41.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:22:41.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:23:11.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:23:11.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:23:41.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:23:41.970 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:24:12.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:24:12.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:24:42.117 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:24:42.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:25:12.205 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:25:12.209 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:25:42.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:25:42.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:26:12.364 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:26:12.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:26:42.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:26:42.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:27:12.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:27:12.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:27:42.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:27:42.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:28:12.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:28:12.690 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:28:42.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:28:42.758 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:29:12.829 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:29:12.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:29:42.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:29:42.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:30:12.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:30:12.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:30:43.061 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:30:43.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:31:13.133 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:31:13.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:31:43.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:31:43.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:32:13.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:32:13.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:32:43.341 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:32:43.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:33:13.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:33:13.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:33:43.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:33:43.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:34:13.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:34:13.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:34:43.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:34:43.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:35:13.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:35:13.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:35:43.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:35:43.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:36:13.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:36:13.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:36:43.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:36:43.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:37:14.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:37:14.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:37:44.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:37:44.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:38:14.211 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:38:14.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:38:44.288 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:38:44.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:39:14.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:39:14.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:39:44.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:39:44.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:40:14.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:40:14.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:40:44.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:40:44.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:41:14.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:41:14.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:41:44.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:41:44.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:42:14.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:42:14.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:42:44.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:42:44.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:43:15.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:43:15.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:43:45.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:43:45.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:44:15.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:44:15.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:44:45.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:44:45.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:45:15.365 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:45:15.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:45:45.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:45:45.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:46:15.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:46:15.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:46:45.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:46:45.583 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:47:15.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:47:15.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:47:45.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:47:45.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:48:15.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:48:15.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:48:45.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:48:45.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:49:15.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:49:15.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:49:46.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:49:46.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:50:16.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:50:16.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:50:46.143 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:50:46.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:51:16.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:51:16.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:51:46.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:51:46.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:52:16.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:52:16.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:52:46.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:52:46.449 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:53:16.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:53:16.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:53:46.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:53:46.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:54:16.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:54:16.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:54:46.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:54:46.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:55:16.802 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:55:16.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:55:46.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:55:46.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:56:16.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:56:16.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:56:47.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:56:47.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:57:17.090 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:57:17.094 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:57:47.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:57:47.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:58:17.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:58:17.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:58:47.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:58:47.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:59:17.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:59:17.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:59:47.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T15:59:47.465 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:00:17.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:00:17.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:00:47.603 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:00:47.607 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:01:17.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:01:17.686 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:01:47.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:01:47.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:02:17.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:02:17.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:02:47.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:02:47.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:03:17.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:03:17.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:03:48.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:03:48.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:04:18.104 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:04:18.107 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:04:48.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:04:48.179 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:05:18.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:05:18.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:05:48.317 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:05:48.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:06:18.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:06:18.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:06:48.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:06:48.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:07:18.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:07:18.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:07:48.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:07:48.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:08:18.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:08:18.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:08:48.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:08:48.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:09:18.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:09:18.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:09:48.904 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:09:48.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:10:18.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:10:18.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:10:49.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:10:49.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:11:19.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:11:19.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:11:49.178 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:11:49.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:12:19.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:12:19.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:12:49.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:12:49.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:13:19.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:13:19.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:13:49.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:13:49.465 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:14:19.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:14:19.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:14:49.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:14:49.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:15:19.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:15:19.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:15:49.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:15:49.802 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:16:19.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:16:19.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:16:49.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:16:49.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:17:19.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:17:19.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:17:50.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:17:50.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:18:20.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:18:20.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:18:50.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:18:50.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:19:20.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:19:20.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:19:50.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:19:50.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:20:20.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:20:20.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:20:50.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:20:50.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:21:20.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:21:20.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:21:50.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:21:50.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:22:20.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:22:20.782 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:22:50.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:22:50.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:23:20.930 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:23:20.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:23:51.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:23:51.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:24:21.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:24:21.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:24:51.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:24:51.173 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:25:21.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:25:21.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:25:51.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:25:51.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:26:21.409 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:26:21.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:26:51.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:26:51.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:27:21.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:27:21.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:27:51.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:27:51.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:28:21.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:28:21.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:28:51.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:28:51.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:29:21.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:29:21.833 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:29:51.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:29:51.899 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:30:21.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:30:21.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:30:52.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:30:52.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:31:22.117 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:31:22.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:31:52.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:31:52.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:32:22.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:32:22.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:32:52.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:32:52.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:33:22.401 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:33:22.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:33:52.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:33:52.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:34:22.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:34:22.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:34:52.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:34:52.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:35:22.687 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:35:22.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:35:52.770 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:35:52.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:36:22.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:36:22.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:36:53.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:36:53.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:37:23.126 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:37:23.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:37:53.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:37:53.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:38:23.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:38:23.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:38:53.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:38:53.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:39:23.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:39:23.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:39:53.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:39:53.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:40:23.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:40:23.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:40:53.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:40:53.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:41:23.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:41:23.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:41:53.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:41:53.800 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:42:23.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:42:23.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:42:53.941 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:42:53.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:43:24.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:43:24.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:43:54.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:43:54.080 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:44:24.227 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:44:24.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:44:54.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:44:54.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:45:24.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:45:24.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:45:54.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:45:54.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:46:24.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:46:24.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:46:54.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:46:54.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:47:24.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:47:24.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:47:54.736 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:47:54.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:48:24.807 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:48:24.810 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:48:54.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:48:54.891 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:49:24.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:49:24.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:49:55.149 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:49:55.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:50:25.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:50:25.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:50:55.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:50:55.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:51:25.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:51:25.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:51:55.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:51:55.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:52:25.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:52:25.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:52:55.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:52:55.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:53:25.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:53:25.691 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:53:55.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:53:55.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:54:25.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:54:25.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:54:55.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:54:55.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:55:26.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:55:26.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:55:56.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:55:56.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:56:26.178 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:56:26.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:56:56.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:56:56.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:57:26.324 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:57:26.328 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:57:56.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:57:56.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:58:26.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:58:26.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:58:56.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:58:56.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:59:26.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:59:26.613 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:59:56.690 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T16:59:56.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:00:26.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:00:26.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:00:56.839 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:00:56.843 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:01:26.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:01:26.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:01:56.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:01:56.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:02:27.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:02:27.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:02:57.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:02:57.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:03:27.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:03:27.192 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:03:57.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:03:57.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:04:27.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:04:27.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:04:57.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:04:57.647 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:05:27.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:05:27.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:05:57.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:05:57.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:06:27.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:06:27.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:06:57.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:06:57.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:07:28.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:07:28.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:07:58.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:07:58.112 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:08:28.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:08:28.183 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:08:58.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:08:58.252 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:09:28.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:09:28.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:09:58.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:09:58.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:10:28.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:10:28.608 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:10:58.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:10:58.787 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:11:28.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:11:28.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:11:58.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:11:58.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:12:29.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:12:29.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:12:59.086 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:12:59.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:13:29.166 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:13:29.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:13:59.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:13:59.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:14:29.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:14:29.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:14:59.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:14:59.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:15:29.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:15:29.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:15:59.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:15:59.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:16:29.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:16:29.608 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:16:59.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:16:59.679 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:17:29.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:17:29.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:17:59.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:17:59.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:18:29.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:18:29.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:18:59.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:18:59.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:19:30.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:19:30.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:20:00.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:20:00.159 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:20:30.227 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:20:30.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:21:00.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:21:00.307 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:21:30.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:21:30.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:22:00.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:22:00.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:22:30.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:22:30.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:23:00.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:23:00.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:23:30.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:23:30.671 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:24:00.778 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:24:00.782 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:24:30.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:24:30.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:25:00.922 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:25:00.926 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:25:30.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:25:30.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:26:01.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:26:01.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:26:31.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:26:31.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:27:01.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:27:01.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:27:31.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:27:31.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:28:01.382 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:28:01.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:28:31.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:28:31.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:29:01.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:29:01.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:29:31.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:29:31.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:30:01.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:30:01.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:30:31.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:30:31.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:31:01.845 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:31:01.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:31:31.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:31:31.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:32:01.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:32:01.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:32:32.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:32:32.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:33:02.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:33:02.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:33:32.187 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:33:32.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:34:02.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:34:02.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:34:32.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:34:32.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:35:02.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:35:02.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:35:32.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:35:32.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:36:02.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:36:02.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:36:32.633 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:36:32.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:37:02.709 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:37:02.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:37:32.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:37:32.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:38:03.002 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:38:03.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:38:33.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:38:33.078 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:39:03.144 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:39:03.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:39:33.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:39:33.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:40:03.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:40:03.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:40:33.368 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:40:33.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:41:03.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:41:03.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:41:33.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:41:33.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:42:03.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:42:03.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:42:33.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:42:33.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:43:03.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:43:03.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:43:33.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:43:33.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:44:03.922 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:44:03.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:44:33.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:44:33.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:45:04.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:45:04.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:45:34.141 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:45:34.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:46:04.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:46:04.221 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:46:34.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:46:34.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:47:04.378 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:47:04.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:47:34.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:47:34.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:48:04.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:48:04.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:48:34.594 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:48:34.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:49:04.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:49:04.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:49:34.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:49:34.767 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:50:04.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:50:04.850 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:50:34.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:50:34.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:51:04.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:51:05.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:51:35.101 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:51:35.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:52:05.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:52:05.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:52:35.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:52:35.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:53:05.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:53:05.343 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:53:35.416 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:53:35.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:54:05.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:54:05.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:54:35.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:54:35.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:55:05.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:55:05.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:55:35.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:55:35.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:56:05.827 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:56:05.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:56:35.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:56:35.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:57:05.985 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:57:05.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:57:36.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:57:36.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:58:06.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:58:06.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:58:36.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:58:36.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:59:06.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:59:06.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:59:36.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T17:59:36.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:00:06.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:00:06.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:00:36.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:00:36.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:01:06.575 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:01:06.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:01:36.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:01:36.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:02:06.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:02:06.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:02:36.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:02:36.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:03:06.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:03:06.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:03:36.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:03:36.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:04:07.014 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:04:07.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:04:37.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:04:37.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:05:07.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:05:07.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:05:37.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:05:37.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:06:07.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:06:07.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:06:37.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:06:37.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:07:07.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:07:07.449 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:07:37.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:07:37.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:08:07.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:08:07.759 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:08:37.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:08:37.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:09:07.904 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:09:07.908 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:09:37.971 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:09:37.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:10:08.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:10:08.043 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:10:38.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:10:38.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:11:08.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:11:08.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:11:38.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:11:38.281 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:12:08.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:12:08.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:12:38.409 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:12:38.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:13:08.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:13:08.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:13:38.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:13:38.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:14:08.626 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:14:08.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:14:38.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:14:38.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:15:08.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:15:08.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:15:38.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:15:38.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:16:08.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:16:08.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:16:38.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:16:38.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:17:09.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:17:09.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:17:39.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:17:39.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:18:09.208 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:18:09.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:18:39.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:18:39.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:19:09.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:19:09.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:19:39.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:19:39.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:20:09.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:20:09.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:20:39.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:20:39.580 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:21:09.649 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:21:09.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:21:39.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:21:39.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:22:09.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:22:09.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:22:39.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:22:39.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:23:09.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:23:09.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:23:40.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:23:40.020 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:24:10.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:24:10.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:24:40.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:24:40.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:25:10.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:25:10.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:25:40.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:25:40.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:26:10.378 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:26:10.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:26:40.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:26:40.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:27:10.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:27:10.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:27:40.617 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:27:40.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:28:10.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:28:10.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:28:40.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:28:40.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:29:10.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:29:10.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:29:40.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:29:40.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:30:10.981 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:30:10.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:30:41.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:30:41.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:31:11.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:31:11.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:31:41.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:31:41.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:32:11.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:32:11.281 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:32:41.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:32:41.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:33:11.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:33:11.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:33:41.660 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:33:41.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:34:11.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:34:11.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:34:41.806 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:34:41.810 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:35:11.878 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:35:11.882 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:35:41.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:35:41.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:36:12.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:36:12.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:36:42.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:36:42.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:37:12.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:37:12.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:37:42.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:37:42.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:38:12.315 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:38:12.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:38:42.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:38:42.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:39:12.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:39:12.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:39:42.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:39:42.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:40:12.640 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:40:12.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:40:42.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:40:42.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:41:12.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:41:12.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:41:42.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:41:42.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:42:12.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:42:12.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:42:43.014 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:42:43.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:43:13.076 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:43:13.080 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:43:43.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:43:43.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:44:13.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:44:13.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:44:43.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:44:43.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:45:13.379 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:45:13.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:45:43.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:45:43.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:46:13.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:46:13.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:46:43.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:46:43.624 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:47:13.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:47:13.695 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:47:43.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:47:43.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:48:13.835 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:48:13.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:48:43.933 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:48:43.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:49:14.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:49:14.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:49:44.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:49:44.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:50:14.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:50:14.160 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:50:44.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:50:44.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:51:14.333 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:51:14.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:51:44.421 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:51:44.425 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:52:14.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:52:14.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:52:44.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:52:44.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:53:14.628 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:53:14.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:53:44.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:53:44.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:54:14.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:54:14.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:54:44.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:54:44.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:55:15.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:55:15.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:55:45.129 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:55:45.133 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:56:15.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:56:15.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:56:45.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:56:45.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:57:15.332 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:57:15.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:57:45.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:57:45.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:58:15.474 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:58:15.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:58:45.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:58:45.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:59:15.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:59:15.671 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:59:45.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T18:59:45.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:00:15.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:00:15.822 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:00:45.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:00:46.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:01:16.070 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:01:16.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:01:46.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:01:46.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:02:16.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:02:16.209 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:02:46.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:02:46.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:03:16.359 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:03:16.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:03:46.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:03:46.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:04:16.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:04:16.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:04:46.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:04:46.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:05:16.664 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:05:16.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:05:46.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:05:46.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:06:16.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:06:16.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:06:46.897 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:06:46.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:07:17.002 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:07:17.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:07:47.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:07:47.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:08:17.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:08:17.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:08:47.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:08:47.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:09:17.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:09:17.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:09:47.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:09:47.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:10:17.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:10:17.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:10:47.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:10:47.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:11:17.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:11:17.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:11:47.669 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:11:47.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:12:17.740 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:12:17.744 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:12:47.811 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:12:47.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:13:17.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:13:17.888 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:13:47.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:13:47.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:14:18.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:14:18.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:14:48.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:14:48.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:15:18.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:15:18.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:15:48.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:15:48.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:16:18.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:16:18.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:16:48.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:16:48.389 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:17:18.462 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:17:18.466 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:17:48.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:17:48.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:18:18.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:18:18.616 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:18:48.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:18:48.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:19:18.761 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:19:18.764 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:19:48.844 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:19:48.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:20:19.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:20:19.035 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:20:49.118 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:20:49.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:21:19.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:21:19.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:21:49.261 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:21:49.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:22:19.326 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:22:19.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:22:49.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:22:49.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:23:19.494 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:23:19.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:23:49.573 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:23:49.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:24:19.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:24:19.638 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:24:49.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:24:49.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:25:19.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:25:19.780 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:25:49.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:25:49.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:26:19.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:26:19.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:26:50.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:26:50.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:27:20.093 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:27:20.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:27:50.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:27:50.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:28:20.244 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:28:20.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:28:50.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:28:50.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:29:20.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:29:20.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:29:50.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:29:50.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:30:20.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:30:20.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:30:50.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:30:50.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:31:20.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:31:20.683 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:31:50.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:31:50.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:32:20.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:32:20.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:32:50.898 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:32:50.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:33:20.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:33:20.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:33:51.162 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:33:51.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:34:21.225 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:34:21.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:34:51.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:34:51.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:35:21.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:35:21.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:35:51.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:35:51.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:36:21.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:36:21.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:36:51.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:36:52.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:37:22.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:37:22.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:37:52.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:37:52.143 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:38:22.220 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:38:22.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:38:52.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:38:52.287 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:39:22.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:39:22.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:39:52.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:39:52.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:40:22.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:40:22.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:40:52.603 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:40:52.607 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:41:22.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:41:22.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:41:52.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:41:52.792 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:42:22.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:42:22.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:42:52.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:42:52.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:43:22.999 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:43:23.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:43:53.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:43:53.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:44:23.158 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:44:23.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:44:53.225 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:44:53.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:45:23.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:45:23.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:45:53.370 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:45:53.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:46:23.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:46:23.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:46:53.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:46:53.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:47:23.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:47:23.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:47:53.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:47:53.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:48:23.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:48:23.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:48:53.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:48:53.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:49:23.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:49:23.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:49:53.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:49:53.946 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:50:24.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:50:24.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:50:54.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:50:54.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:51:24.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:51:24.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:51:54.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:51:54.307 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:52:24.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:52:24.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:52:54.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:52:54.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:53:24.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:53:24.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:53:54.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:53:54.593 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:54:24.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:54:24.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:54:54.725 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:54:54.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:55:24.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:55:24.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:55:54.852 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:55:54.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:56:24.927 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:56:24.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:56:55.005 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:56:55.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:57:25.077 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:57:25.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:57:55.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:57:55.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:58:25.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:58:25.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:58:55.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:58:55.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:59:25.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:59:25.364 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:59:55.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T19:59:55.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:00:25.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:00:25.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:00:55.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:00:55.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:01:25.645 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:01:25.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:01:55.720 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:01:55.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:02:25.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:02:25.799 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:02:55.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:02:55.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:03:25.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:03:25.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:03:56.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:03:56.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:04:26.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:04:26.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:04:56.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:04:56.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:05:26.235 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:05:26.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:05:56.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:05:56.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:06:26.375 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:06:26.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:06:56.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:06:56.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:07:26.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:07:26.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:07:56.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:07:56.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:08:26.673 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:08:26.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:08:56.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:08:56.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:09:26.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:09:26.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:09:56.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:09:56.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:10:26.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:10:26.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:10:57.022 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:10:57.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:11:27.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:11:27.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:11:57.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:11:57.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:12:27.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:12:27.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:12:57.332 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:12:57.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:13:27.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:13:27.408 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:13:57.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:13:57.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:14:27.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:14:27.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:14:57.609 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:14:57.613 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:15:27.705 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:15:27.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:15:57.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:15:57.784 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:16:27.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:16:27.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:16:57.911 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:16:57.915 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:17:27.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:17:27.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:17:58.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:17:58.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:18:28.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:18:28.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:18:58.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:18:58.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:19:28.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:19:28.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:19:58.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:19:58.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:20:28.579 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:20:28.583 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:20:58.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:20:58.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:21:28.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:21:28.743 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:21:58.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:21:58.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:22:28.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:22:28.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:22:58.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:22:58.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:23:29.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:23:29.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:23:59.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:23:59.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:24:29.182 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:24:29.185 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:24:59.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:24:59.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:25:29.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:25:29.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:25:59.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:25:59.417 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:26:29.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:26:29.490 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:26:59.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:26:59.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:27:29.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:27:29.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:27:59.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:27:59.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:28:29.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:28:29.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:28:59.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:28:59.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:29:29.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:29:29.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:29:59.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:29:59.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:30:30.048 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:30:30.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:31:00.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:31:00.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:31:30.193 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:31:30.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:32:00.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:32:00.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:32:30.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:32:30.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:33:00.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:33:00.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:33:30.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:33:30.448 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:34:00.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:34:00.526 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:34:30.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:34:30.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:35:00.659 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:35:00.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:35:30.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:35:30.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:36:00.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:36:00.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:36:30.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:36:30.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:37:00.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:37:00.953 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:37:31.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:37:31.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:38:01.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:38:01.095 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:38:31.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:38:31.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:39:01.220 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:39:01.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:39:31.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:39:31.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:40:01.366 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:40:01.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:40:31.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:40:31.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:41:01.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:41:01.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:41:31.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:41:31.580 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:42:01.642 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:42:01.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:42:31.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:42:31.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:43:01.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:43:01.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:43:31.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:43:31.850 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:44:01.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:44:01.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:44:31.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:44:31.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:45:02.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:45:02.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:45:32.126 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:45:32.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:46:02.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:46:02.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:46:32.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:46:32.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:47:02.441 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:47:02.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:47:32.514 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:47:32.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:48:02.578 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:48:02.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:48:32.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:48:32.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:49:02.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:49:02.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:49:32.817 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:49:32.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:50:02.882 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:50:02.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:50:32.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:50:32.958 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:51:03.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:51:03.019 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:51:33.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:51:33.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:52:03.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:52:03.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:52:33.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:52:33.252 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:53:03.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:53:03.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:53:33.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:53:33.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:54:03.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:54:03.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:54:33.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:54:33.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:55:03.601 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:55:03.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:55:33.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:55:33.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:56:03.829 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:56:03.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:56:33.900 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:56:33.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:57:03.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:57:03.968 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:57:34.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:57:34.040 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:58:04.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:58:04.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:58:34.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:58:34.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:59:04.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:59:04.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:59:34.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T20:59:34.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:00:04.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:00:04.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:00:34.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:00:34.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:01:04.498 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:01:04.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:01:34.570 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:01:34.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:02:04.633 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:02:04.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:02:34.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:02:34.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:03:04.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:03:04.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:03:34.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:03:34.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:04:04.937 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:04:04.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:04:35.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:04:35.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:05:05.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:05:05.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:05:35.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:05:35.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:06:05.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:06:05.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:06:35.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:06:35.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:07:05.359 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:07:05.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:07:35.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:07:35.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:08:05.523 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:08:05.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:08:35.594 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:08:35.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:09:05.654 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:09:05.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:09:35.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:09:35.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:10:05.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:10:05.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:10:35.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:10:35.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:11:05.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:11:05.971 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:11:36.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:11:36.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:12:06.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:12:06.103 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:12:36.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:12:36.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:13:06.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:13:06.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:13:36.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:13:36.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:14:06.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:14:06.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:14:36.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:14:36.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:15:06.552 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:15:06.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:15:36.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:15:36.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:16:06.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:16:06.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:16:36.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:16:36.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:17:06.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:17:06.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:17:36.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:17:36.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:18:06.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:18:06.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:18:37.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:18:37.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:19:07.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:19:07.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:19:37.201 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:19:37.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:20:07.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:20:07.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:20:37.352 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:20:37.355 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:21:07.415 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:21:07.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:21:37.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:21:37.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:22:07.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:22:07.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:22:37.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:22:37.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:23:07.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:23:07.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:23:37.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:23:37.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:24:07.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:24:07.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:24:37.916 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:24:37.919 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:25:07.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:25:07.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:25:38.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:25:38.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:26:08.128 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:26:08.133 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:26:38.224 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:26:38.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:27:08.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:27:08.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:27:38.366 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:27:38.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:28:08.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:28:08.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:28:38.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:28:38.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:29:08.550 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:29:08.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:29:38.626 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:29:38.629 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:30:08.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:30:08.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:30:38.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:30:38.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:31:08.814 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:31:08.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:31:38.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:31:38.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:32:08.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:32:08.958 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:32:39.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:32:39.040 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:33:09.098 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:33:09.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:33:39.170 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:33:39.173 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:34:09.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:34:09.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:34:39.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:34:39.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:35:09.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:35:09.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:35:39.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:35:39.452 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:36:09.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:36:09.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:36:39.582 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:36:39.585 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:37:09.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:37:09.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:37:39.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:37:39.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:38:09.781 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:38:09.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:38:39.851 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:38:39.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:39:09.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:39:09.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:39:39.987 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:39:39.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:40:10.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:40:10.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:40:40.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:40:40.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:41:10.181 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:41:10.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:41:40.257 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:41:40.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:42:10.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:42:10.324 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:42:40.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:42:40.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:43:10.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:43:10.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:43:40.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:43:40.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:44:10.607 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:44:10.610 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:44:40.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:44:40.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:45:10.759 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:45:10.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:45:40.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:45:40.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:46:10.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:46:10.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:46:40.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:46:40.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:47:11.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:47:11.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:47:41.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:47:41.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:48:11.179 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:48:11.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:48:41.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:48:41.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:49:11.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:49:11.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:49:41.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:49:41.391 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:50:11.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:50:11.454 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:50:41.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:50:41.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:51:11.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:51:11.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:51:41.673 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:51:41.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:52:11.850 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:52:11.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:52:41.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:52:41.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:53:11.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:53:11.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:53:42.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:53:42.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:54:12.131 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:54:12.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:54:42.228 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:54:42.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:55:12.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:55:12.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:55:42.364 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:55:42.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:56:12.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:56:12.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:56:42.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:56:42.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:57:12.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:57:12.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:57:42.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:57:42.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:58:12.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:58:12.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:58:42.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:58:42.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:59:12.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:59:12.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:59:42.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T21:59:42.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:00:13.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:00:13.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:00:43.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:00:43.131 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:01:13.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:01:13.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:01:43.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:01:43.268 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:02:13.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:02:13.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:02:43.417 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:02:43.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:03:13.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:03:13.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:03:43.704 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:03:43.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:04:13.773 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:04:13.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:04:43.862 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:04:43.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:05:13.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:05:13.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:05:43.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:05:44.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:06:14.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:06:14.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:06:44.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:06:44.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:07:14.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:07:14.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:07:44.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:07:44.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:08:14.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:08:14.417 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:08:44.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:08:44.487 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:09:14.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:09:14.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:09:44.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:09:44.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:10:14.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:10:14.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:10:44.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:10:44.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:11:14.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:11:14.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:11:44.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:11:44.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:12:14.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:12:14.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:12:45.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:12:45.067 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:13:15.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:13:15.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:13:45.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:13:45.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:14:15.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:14:15.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:14:45.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:14:45.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:15:15.416 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:15:15.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:15:45.499 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:15:45.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:16:15.559 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:16:15.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:16:45.631 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:16:45.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:17:15.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:17:15.697 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:17:45.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:17:45.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:18:15.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:18:15.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:18:45.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:18:45.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:19:15.991 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:19:15.995 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:19:46.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:19:46.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:20:16.124 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:20:16.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:20:46.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:20:46.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:21:16.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:21:16.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:21:46.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:21:46.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:22:16.410 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:22:16.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:22:46.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:22:46.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:23:16.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:23:16.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:23:46.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:23:46.638 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:24:16.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:24:16.690 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:24:46.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:24:46.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:25:16.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:25:16.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:25:46.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:25:46.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:26:16.980 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:26:16.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:26:47.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:26:47.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:27:17.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:27:17.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:27:47.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:27:47.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:28:17.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:28:17.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:28:47.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:28:47.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:29:17.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:29:17.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:29:47.456 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:29:47.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:30:17.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:30:17.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:30:47.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:30:47.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:31:17.654 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:31:17.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:31:47.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:31:47.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:32:17.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:32:17.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:32:47.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:32:47.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:33:18.049 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:33:18.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:33:48.121 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:33:48.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:34:18.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:34:18.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:34:48.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:34:48.260 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:35:18.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:35:18.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:35:48.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:35:48.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:36:18.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:36:18.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:36:48.533 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:36:48.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:37:18.597 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:37:18.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:37:48.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:37:48.697 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:38:18.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:38:18.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:38:48.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:38:48.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:39:18.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:39:18.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:39:48.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:39:48.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:40:19.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:40:19.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:40:49.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:40:49.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:41:19.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:41:19.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:41:49.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:41:49.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:42:19.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:42:19.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:42:49.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:42:49.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:43:19.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:43:19.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:43:49.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:43:49.710 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:44:19.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:44:19.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:44:49.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:44:49.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:45:19.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:45:19.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:45:49.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:45:50.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:46:20.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:46:20.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:46:50.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:46:50.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:47:20.219 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:47:20.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:47:50.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:47:50.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:48:20.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:48:20.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:48:50.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:48:50.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:49:20.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:49:20.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:49:50.696 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:49:50.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:50:20.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:50:20.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:50:50.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:50:50.833 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:51:20.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:51:20.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:51:50.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:51:50.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:52:21.052 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:52:21.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:52:51.124 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:52:51.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:53:21.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:53:21.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:53:51.273 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:53:51.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:54:21.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:54:21.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:54:51.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:54:51.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:55:21.498 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:55:21.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:55:51.570 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:55:51.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:56:21.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:56:21.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:56:51.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:56:51.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:57:21.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:57:21.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:57:51.885 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:57:51.889 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:58:21.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:58:21.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:58:52.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:58:52.019 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:59:22.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:59:22.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:59:52.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T22:59:52.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:00:22.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:00:22.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:00:52.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:00:52.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:01:22.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:01:22.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:01:52.462 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:01:52.465 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:02:22.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:02:22.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:02:52.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:02:52.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:03:22.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:03:22.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:03:52.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:03:52.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:04:22.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:04:22.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:04:52.892 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:04:52.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:05:22.963 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:05:22.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:05:53.043 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:05:53.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:06:23.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:06:23.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:06:53.182 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:06:53.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:07:23.245 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:07:23.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:07:53.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:07:53.325 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:08:23.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:08:23.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:08:53.465 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:08:53.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:09:23.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:09:23.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:09:53.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:09:53.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:10:23.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:10:23.666 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:10:53.734 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:10:53.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:11:23.805 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:11:23.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:11:53.877 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:11:53.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:12:23.941 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:12:23.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:12:54.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:12:54.023 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:13:24.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:13:24.094 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:13:54.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:13:54.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:14:24.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:14:24.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:14:54.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:14:54.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:15:24.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:15:24.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:15:54.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:15:54.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:16:24.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:16:24.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:16:54.608 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:16:54.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:17:24.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:17:24.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:17:54.773 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:17:54.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:18:24.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:18:24.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:18:54.911 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:18:54.914 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:19:24.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:19:24.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:19:55.050 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:19:55.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:20:25.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:20:25.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:20:55.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:20:55.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:21:25.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:21:25.268 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:21:55.341 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:21:55.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:22:25.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:22:25.408 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:22:55.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:22:55.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:23:25.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:23:25.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:23:55.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:23:55.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:24:25.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:24:25.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:24:55.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:24:55.841 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:25:25.901 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:25:25.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:25:55.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:25:55.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:26:26.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:26:26.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:26:56.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:26:56.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-13T23:27:24.402 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-06-13T23:27:24.402 DEBUG:teuthology.task.console_log:Killing console logger for smithi043 2024-06-13T23:27:24.404 DEBUG:teuthology.task.console_log:Killing console logger for smithi053 2024-06-13T23:27:24.404 DEBUG:teuthology.exit:Finished running handlers